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ABSTBACT . ' * ' . 

This report of the EISO project, the responsibility 
of which is the operation of an online bibliographic search service 
for edticators of Ontario, concentrates on research findings collected 
after EISO had- been operational for 16 months. The or garni zation,- 
role, and level of. satisfaction of EISO users are treat^ed, the^ <• -^^ 
system's impact on a school board in the Northeastern region of 
Ontario i& outlined, and the economics of operating an online 
bibliogr'aphic retrieval and duplication service are assessed. A ^ 
state- of- tl^e-art review 'of the EBIC data base search services in" , 
.Canada is also included, as well as a discussion of alternative 
organizational structures for EISO. Appendices include samples of the 
evaluation questionnaire used to collect data> oh psers, the pamphlet 
and brochure publicizing ^ISO, and order forms fo^ ^;opies, of original 
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ABSTRACT 



Early in 1975, 'the- Qntatia ^Ministry o£ Education contracted -with The ^ ^ 
Ontario .Insti-^te fdr' Studies in. Education to; uncsrzak^ a 'research P^o^_ 
ject.to examine the "viability' o£ operating an^on- line" bib liogjraphici sdareh 
,service "for the educators ^o£ the province. The "project'^ was to .stiidy,^ 
among, others,* the nature and levils of- demand in Ontario for sydh a serv- " 
ice; to develop' and rfefine^ methods o£ placing search orders,' order' deli- 
very, and 'advertising; to detemmie manpower./ tedinical requirements and 
fiscal viability; and to assess . the effectiveness of.an intermediaxy in. 
.interacting with users in a •remote .geographic setting in NortJiem Ontario. 

' ,The earliest phases of -the project involved inplementation of the 
search -service. Accesi to .the data bases maintained by System Develop- 
ment Corporation and Loc^eed, both' in^ California, was provided by a 
tetminal located in.:the^' 01 SE .Library. Copies of' documents cited in 
computerrgenerated bibliographies were .made aVSilable for requestors in 
microfi<ie^or haid copy fowtk Educational Infoirraaticn Qonsiolt ants were 
trained to help\larify^ and neg requests from' users in -the North 

Bay .area 6^ t)ntario. .These ef forts "were the subject of . the first ,Intey>im 
Eeport.cov&ri^^ttie period March 1975 - Februa'ry^ 1976. That report con- 
^centrated ort^^. early phases of the_ pro j eqt : ^' 'fie- relevant literature 
■ was reviewed^^ihfcOTiceptual framework used_ to collect 'and analyze t^e 
-data 'was described,' the early phases 'of '4^^ of the%eardi . 

servi'ce'were detailed, and preliminary findings were ^presented. 

. '.While develo^entai: and theoretical aspects- received most enphasi 
in the . first annua£ -report this Second Interim j?eport concentrates on 
' the' researdi' findings collected after the search service had been in 
operation 16 mci^ths. ,'Thfe organization, role, , and level of satisfaction 
of EISO users are treated;' the imfjact of EI SO on a. school board id tHe 




NcjrtheasterTi Region o± Ontario xs ouriinea; xne economxcs or opexaxin^ 
an on-line'biblidgTiaphic retrieval and duplication service^ is. .assessed- . 
A state-of-the-art review- o£ ERiK data, base ^earcli services in Canada 
constitutes Chapter 6 ^vhile the fina'l chapter considers ' alternative _ organic 
zational structures for EXSO. i^pendices reproduc^ samples o£ the evalua- 
■tion questionnaire ; usfed to collect data on users, the pamphlet and 'bro- 
chure Fjublicizing the EISO service, and oi^der fcyns^ fof coxjles- of original 
materials. - . ■ 
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IntrocJuction 



In^l975, against a Uackground bf/lrap id development: in the field o£ infor- ^ 
nation Jscience, the Ontario Ministry ,o£ Education' funded- a contract titled 
the Educational Information System for Ontario (EISO). to develop, evaluate 
aid analyz^^ an information dissemination system based upon conputeri'zed 
retrieira.1 of bibliographies. EISO Jias now been in operation forjra' year 
and a half, "pipfvdding both a search service that locates references to 
literature .on a multitude ^ of educational topic^, and a di5)licatiQn service 
that .provides copies of original materials located by the service..' : 

EISO* s ' first Intert^m Repor^ty submittec^ in J(fe.rch 1976, recounted 
the creation of EISO, its basis in theory and practice, and an initial 
assessment of its effectiveness. This report, building on 'the previous 
one, undertakes a detailed analysis of the types df individuals v3io haVfe. 
used EISO, their levels of satisfaction with the service, the service's 
in5)act on their organizations, and the economics of "operation/ After a 
survey of the development of on-line information services in. Canada, the 
report concludes with an outline of organizational structTores that might 
be? used if EISO is to become a permanent service. 

Prior to the creation of the Educational Information System for 
Ontario, no conputer-based, on-line bibliographic search service aimed 
prijnarily at educators existed in this province. Nor did there at that 
time exist a data base consist^g of entirely Canadian educational 
materials or documents.' Obviously, then^ if serious study was to be 
undertaken preliminary to the possibly creation of any such provincial 
or national system, at least two ^^feas- woiild have to be explored and data 
collected and analyzed before any further progress could be made, t One of 
these areas was the tecJinicaGL requirements and feasibility of creating an. 
Ontario ciata base.of educational infoimation. To examine this higMy 



ouupl4x> ~a5pect"^o£~ijtf^ stoi^age -"and retrieval j the Odtax±o iiiiiistTy 

of Education contracted with the Metropolitan Schiool Board q£ Toronto to ^ 
tmSert^e ^ project entitled Ontario Educational - Research "litfoiraation' 
System CQNTER^p-. To look into the questions of disseminati<5n 'and tttili-^ 
•zation oif iii^mnation, ' the Miiiistiy funded ^SQ. •• . 

EISO set iip a fully operational infinnation iservice offering an . 
interactive dn-liiie bibliogy^hic search sfervice td the educators of • 
this province first , by providing them^-acceSs to the •existang.^duCational 
.Resources Infoxmatioii Centre C^RIC) data/base, and lat^rlto other data 
base^, siichL_as PsyohoZogi^cat Absi^:i^aot^s ^ ^^kcoept^i^orLCil OhvZd Eduaa-ttori . 
J&BixPoci^-^. Soatat %c^eriaes Ci^i>xti.on' lyjk^^ So<ylotogi.aaZ jkbstr^aa-Ss-^ and 
Other, data bases .relevant to educatxjfrs. From the very/dEirst, then,^ EISO 
differed from the usiial research y:rantract' in. that i^^ not only 4^o pro- 
vide a rigorous research stuc^ ^xmly grouncfed in thegretical concepts, 
but it was also to have a large developmental , component in t3ie inrpleraenta- - 
tioii of a search service available td edijcators .on a^ fee-paying Sasis. 
Thus , not only were normal aspects of contract' research such as research 
design, data ^collection and analysis reqiiired, bnt also some^more unusual- 
activities. Among these were creation of a business system, ^a^ set- oi? 
piiblicily materials, and a program f6r training Educatiorial . I^f orination 
ConsixLtants who were , to act as infoxifiation^iriteinnediaries in^ geographically 
remote areas. Professional development activities, seminars, worlcshops, 
aiid demonstrations added still other aspects ^o the study. . 

To use the search service EISO "provides , the -educator submits "his - 
infoimation request to the search analyst, a specially tr^ned reference.: 
librarian, who rewords the content to conform to a list^of subject headings, 
'designed for conputer scanning of the appropriate data base. The search 
analyst queries the bibliographic^^data base using either of twd search 
systems, Lockheed Information System, (LIS) 's DIALOG or System- Development . * 
Corporation CSDC>^s ORBIT, ivhen conibinatians of siibject .headings are 
entered, the nuiriber of relevant citations aijd sanple* citations -are printed 
CTi-line. If the - citations are appropriate,' the complete bibliography is 
printed off-line ^d mailed to the requestor. ^ 

Should, thie client i>rLSh to obtain copies C5f .the original documents 
cited in the- bibliography - he may order ERIC documents av^ia^ble on micro- 



fiches and paper copies of jpumal articPes from EISO. JR^Elpr prints from 
ERIC f iche are available frran the ERIC Document Reproduction Service iri^ * 
the United States. ^. . . . ^. ' 



To evaluate EISO, an IrtforEnation System Model was designed Wiictp 
fbcused on the systeSi^s inputs, processes andlDutputs. The p^n^ry in- 
.puts were 'identified as the user/ who is characterized by .sdcial traits 
stzch as his position, age,, ediicatipn; the search analyst; and the NCon5)uter 
^ system. The process phase included question negotiation, "reference 
retrieval, document^retrifeval and* knowledge o£ acqxiisition/ - The major, 
oiitput variable of concern was the user's satisfaction with the service^ " 
; ^y . anialyzing varaous combinations of inputs and processes, it- was hoped 
thaf factors' affe;cting satisfacti(^ could be^ identified, so that iiiprove- 
i ^Bjents could l?e mafle in the' systCTi* • ^ 
-V ^ Smce. EISO was -a new service, the; evaluation" took on an a^ed * 
> ccHigjlexity. ^It is widely recognized that individuals who try innovations' 
tend to be a: separate breed. Normally , innovators are nfale , ^-well educated, 
5r and ambitious. Thus, in assessing the 'rate^ of adoptiOTi of EISO by educa- 
"rors, we focused on the demographic profiles? of ^usersr to see if they, fit ' 
♦the expected pattern. An adoption/ of an innovations model was used to ' ^ 
, plan^ the schedule of publicity ancf^ demons trat ions. That is, it was' :^cog-- 
nazed potenta,aii ttsers had to go. through five stages^of adoption: awareness 
search for more^ iiifop[nat ion, trial use*, evaluaticHi and a decision to adopt. 
Therefore,. EISO committed great effoirts during its first year at "building - 
awaifeness and providing free trial searches'. -'If, as normally expected, 
. ^adoptian followed an S* curve, then relatively" :^w people wpuld become 

regular users of EISO in its first year or two, biit the number of -users * 
would clinif' rapidly thereafter. 

- Attraction of users would be relatively easy* if EISO provided 
free service; but it does not. A major focus, .then, was the assessment ^ . 
of the relationship between price and dema&d. EISO also sought to 
establish its own true cost, so that realistic data wotild be available 
for setting prices and rates, of subsidization in the ^future. 

The work in EISO^s first year formed the foundation fcrr its accomp- 
- lishmente during the second, year. The same basic model for assessing the 
service still applies, as does the focizs on user satisfaction and- the ' 
economics' of operations However, it is now possible to analyse the 
system in. far greater detail than ivas the case one ^year ago. 



. Organization, and Role o£ the EISO -User . • " 



■J " 



EISO users* come from all parts of the' province , hold many different roles 
in many, different organizations? and have different purposes in mind idien 
requesting, a bibliography from the Educational Information System for .' ■ 
Ontario. This chapter describes various aspects of EISO's clientele, and 
ccMijpares their demographic, profiles d^ring the first and second year of " 
e the service. ;As- in. the first Interim Report, we use the "d±st±ncti6n 
between the^insti-^utional or nomothetic dimension and the individual' or 
idiograph4.c dimension in order to group th© variables that define tHe ' 
profiles,, and assume that the two ^fimction together to help explain users* 
behaviour and "their decision t© use\;he system- Most dataTwere collected 
via the EISO User .Evaluation-QuestioniMfc^re, which has been used throughout 
thg study. ' 

I. 

. - . - i 

User Survey ■ • 

* ' > . ■ * * 

Every user is sent an EISO User Evaluation Questionnaire^.- about^ six weeks 
after a search has been . completed and a bibliography sei^. This question- 
naire, the original . version {or Version A) of which app^rs in .Appendix C 
of the first Interim Report, was revised in" the second yekr in order to 
refine its form, conterit and reliability.. . TI>e new^ version C^^:^ndix A) 
is abdut one- third shorter than the first version, "and .is typesef in the 
eight by eight, inch format losed for EISO printed materials. Version A 
was .used from Jiily 1, 1975 to March 51, 197(5 and' Version B has been used . 
since t^^,.- In addition to both primary versions of the user evaluation 
questionnaires are two briefer questionnaires thg:t have been prepared' for 
sending to those users who do not return the longer versions. - Finally, 
there are two EISO Service Evaluatipn Data Sheets CJ\ppendix.D''of the first 
Xnterim l?eport, and .Appendix B in this reporf) which are conpleted in-house 



by the EISO searph analyst and lilpraiy assistant^* As mucK da^^- as possible 
are recorded ah these data sheets ' io order to lessen the user's iwrden in 
. -supplying data, needed for EISO's researdfci .and, '^valuation activities. • 
Rates, o£ retiiiH "•£ot questionnaires have^jB^een quite "satisfactory ■ ' 
-overall, though there is little dat^ on some . items, as the frequencies 
■recorded in tables later reveal. ^In alL,,^^data for^S? of ''-Sier^yd. searches 
EISO conducted during its. first, year ^re' assemble dr. That is, data are 
available^ 83%;pf searches com^l^ed. Actual' dates of '"fi^t^^yeax" " 
searched, Allowing for ^EISO's.:-tiferee ntonth start-ijp' period, span the period 
from July. 1, ;i975 to Match. 31, " 1976. Data forisec<:Hid>ear searches are'. ^ 
less conplete. At the- time of analysis,. 11?, evaluation questi6nnaii=e.s / " ' •. 
had been returned from among 285 that^had been ^nt. * These' cover the 
period from A^ril 1, 1976 to October 31, 19 76.^-^6 ^expect this 42% retimi 
rate will improve as. follow-up questionnaires are returned. - . 

In making comparisons between data^reported here for EISO' s first 
year and those reported in' the first year's Interim Repqrt, the reader ~ 
^ should note that more complete data are used' in this vers ion- than were 
.available previous ly.^VThaf report used a sanple of 122 Csijnilar to the 
data set being used in this report -for ..second year dataj, wh^le this 
report uses a sanple of 387. Hence, discrepancies will occur between the, 
two reports, "discrepancies "which should be decided in favour the . " 
statistics given herein. ' ' . I . 

The description of the findings for the first two years o^operations 
that follows begins by considering the organizational setting, followed by-i 
•the organization itself and, finally, theAndSvidual role the user plays 
and several personal characteristics that may relate, to the way that role 
is playedT. • - \ ' 

- • . i-tGeographical Location of Users ' ' • ' 

In a province the size of Ontario, geography is often a major >JDarrier to 
the provision of equitable services." Individuals ai^ prgsmi^tions in 
the larger urban areas have easy ac&ess to all types^ of commodities and 
services, including, information. The. same cannot be, said for those 
located far from urban areas and. from the popiaiation centres along Lake 
Ontario. One goal EISO has is to overcome these barrier with respect to 
the provision of information on educational topics. It took as its test ' 
area the. Ministry of Education's Northeastern Region (Figure - 1} which 
st:petches from- the Trent-Severn, waterway to James Bay. . Iji. this region, V 



FIOJBE 1 — Northeastern Ontario Regidn CDista^ct^ .q£ Cochrane, Nipissihg, . 



^Par^ So\?n<i, Timiskaming; MiskdksC)} 




^^Qatario' Ministry of Education. D-lr'ec-bory of Eduoa-t-lon, 2975-76, p. , 116, 
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Ednc^tional Information ConsTj3.tants were trained, numerbus demonstrations 
were he^ld, and. EISO searches were provided at a reduced " rate . In fact 
eacli School- board was- provided one free search^for eveiy 1,000 students 
enrolled in the^bpard. Thereiafjter,- searches^ cost only $20, rather -^an 
$30 as .elsewhere., in -the province. . ' . - 

~ -1 EISO by no iriea^ limited it^- activity" to . €he Northeastern Region. * 
Demqbistratians vrexe conducted elsewhere^ brochures^i^egce ^ent to all 
s^i^pls, and adyiertis^gnts and, articled appear^ in pr^essional journals 
Yet, s^ince greater efforts were made in the Northeastern ifegicai, CTie woyld 
-expect tha'g if these ei^orts-were effective, a disproportionately large" 
nimiber of search reqiiests would have com^ f^ region. 

. .Table 1 reports the percentage ofi^ers from the Northeastern Region 
in EISO's first two years of operation. In both years, the reg:^3n was 



"\ ^ TABLE 1 - - USl^ 

A — ^ 


fe.LOCATHU 


IN NORTHEASTERN- REGIC^ (REGIONr .3) . J 


Response ' 




* 


Percent ' ^ 




Year 1- " 
(n = 380) 


^ ' Year 2 

Cn ^ 119) 


^es ■■ 




„ - '■ ( 

13.9 




■ No " " . 




86.1 


> 90.-8 



o\5Brrepresented, ^as. had been expected. IVhile it has only alpout ,4% of -ihe 
-i?3X»vince*s enrolment in elementary and secondary schools, over twifce this 

percentage used the service in each of the two years, a. The declini .in- the 
"second year, dErom 14% to 9% is in part due to the. exhaust ion of free* 

searches. As will be noted in Table 2, several of the larger boards teo^e. . 

used all of the free searches that have been allocated, and must iiow pay 

$20 for each one requested. ^ f ■ ■ . ' ... 

^ A broader look at the location of liters and th.eir organizations is^ 
taken in - Table 3, where the province is barok^Tdown according to distr;i^ts, 
counties or regions, and cities.. ""It is particularly, notable that IVfeltos- 
politari Toronto, with about 23% of the school enrolment in. the province , 
sr?>plied over 50% of the users. This' fact is of course explained by 
Toronto's preeminence in graduate education and' educational research. 
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TABLE 2 -- 


ALLOCATION AND USE OF FREE SEARCHES "IN 


— — ' 


NORTHEAbTH<N REGION ' V" 






Free Searches 




Organization 

' \ 


•~ ^ ■ • — — ■ ^— 

- ' . - - Allocated* ; Used^ 


- jPaid Searches. 



Aixy Tcjwnship . ♦ 

Beaknfell Township 
'"CFB North. Bay . . . 
„ CFS - Mbos^nee' • ^ 

■""^^t^nfieldvTownship _ / • 

Canadore CAAT ^ ' 
Cochrane- Iix>quois Falls 
Cbciirane-i^roquois §ails DRCSS 
East Parry Soimid " '/ 
Pfearst 

• . ' { ^ : 

. Hearst DRCSS ^ - 

X^uskasing 

i^puskasing JDRCSS 
^ ICLrkland Lake ^ 
^ Kirkland Lake DRCSS 




2^ 

2 . 
2 

2 ^ 
2 

5 
5 
5 
5 
5 

5 

5 . 

5^ ' 
5 

5 ^ 



0 
0 
0 
0 

^•0. 



2 
1 
0 

4. 

.4 

' o' 

3 
1 



0 
.0 
. 0 

0 

0 

0 
0 

cr. 

0 
0 

d 

0 
0 
0 
0 



Ministirx of Education 
Moose' Factory Island 
Moose No., 1 RCSS - 
Moosonee DSAB - . 
Murchisbri and Lyell Tovmship 



5 
2 
2 
2 
'2 



4 
1 
0 

- 0 

- 0 



0 
0 
0 
0 
0 



Muslcoka ■ ^ 
Northern CAAT 
' OISE Field C^tre - 
Nipissing ^ 
-^ipissing Faculty of. Education 

\ 

^^^^^issing. DRCSS 

Pinard Township " ^ * 

Tinnnins ■ ' 

Tinnnzns DRCSS - 
Timiskaming ? 



8 
S 
5 
13 
5 



*10 
'2 
7 
5 
6 



3 
■5 
5 
10 
2 

3 
0 
3 
0 
2 



0 
3 
0 
0 
0 

0 
0 
0 



West Parry Sound 



- 5 



0 



8 
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TABLE 3 — LOCATieN OF' USER^S ORGANIZATION 



Pei*ceiit: 



Location ^ — ^ — ■ -■ = 

* — ' Year 1 • - ' Year '2 

* Cn = 386) Cn =. 119) 



District 14.8 , - ' 7.6 



Cbmty or Regional : * * * :\ ' ' ■ 

Goveinnieiit: >: ^ 23.3 . 24r4'^ ♦ 



r 



trcpolitan Tofento 49-. 5 . 53: 8 



Ottawa , , l-.O . . 2-5 ^ 



Landqn , ^4.9 . . . 4.2 

"- • ' . 

Hamiltan 0.5 ^ - 0 

^' . . ■ ' • ^ 

Windsor 2.6 0 

Sudbxiry . 1.3 ^ 5.0 

tt - ■ ■ 

'Canada (not Ontario) '1.0 0.8 



Not Canada 



1-0 



But more iii5K>rtant, Table 3 reveals how the' Toronto inarket is the mainstay^ t- 
o£ an educa%ional iiifoxmation , service. Alone, it probably can siipply 
^ enougji users to justify^ the capital- anc^' personnel' expense o£ jnaintaining 
the service, This point is o£ iinportaJice later when we discuss the ' 
< ^ ^i^rgence.of other -educational informatri^r^e^ in* Ontario. ^ 

-Another notables/feature in Table 3 is tlie relative decrease in 
/ usets in northern districts, Vhich is probably explained- by the ""decrease - 
Ui usage in the Northeaster Region and the increase in usage in Ott^a 
and, particularly, 'Sudbury. Whether these' clianges will result in a 
loiiger teiin increase in' these cities,^ we cannotr say; the^^cline in use 
irf.^indsot shows that' small' percentages caji^change^ qiiickly V Worth- inves- ^ 
. \ tigating, in tiie latter case, i^' the possibility that users I^ve been 
lured away to anotKer search service, either in Windsor or in nearby 
Detroit.^ ^ " \ ^ \ ^ ' ' 

Hi summary^ EISO users come £iWi all parts of the province, with 
about half from Metropolitan Toronto alone. Efforts to stimulate usage 
by giving free searches, training "EICs, presenting workshops, etc. were 
* effective in the Northeastern Region and will probably have a moderate 
continuing effect after free searches are exhausted- and knowledge of the 
service has become commonplace, . ^ . ' . 



r EISO Users ' Orgajiizations 

Organizational factors are probably more iiiportant' than the geographical 
ones in explaining why .a person request:s a search, and paramount among 
^these is the type of organization to which the user belongs and the ^ 
purposes it has. Table 4 groiips -lolers according to twelve kinds of 
organizations^ Iri its first year, school boards were EISO^s top users, 
but their leadership in this has yielded to OISE in the second year. 
Overall, it is fair to say that on the average each of the two represen-fe 
about 40% of the service's clientele. Usage by faculties of education 
has increased from 2.1% to 7.6%, while lose elsewhere had tended to hoXd 
steady. ' The fact that faculties of education plus OISE now account for 
half of all 'users points to their dEundamental position in justifying an 
educational information service. That is,- they^would appear to provide 
a sufficiently large clientele to justify the service's existence^. Yet 
it is also clear that continuing efforts are needed to enlist users fr om 
boards. Unlike professors and graduate students, their day- to-- day lives 
do not include use of a library. It is necessary for the library to go 
to thei^: , : 

10 

o ■■ ■ 
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TABLE 4 --• ORGANIZATION OF PRIMARY ASSOCIATION 



Organization 



^ Percent 



' — ' ^ — , 

Ye^t 1 • ' ■ " - Year .2 
' ^ - Cn = 380) ^ Xn = 119) 



-public -Board . 54.2-^. , - 27.7- 

• ■ - ? - S 44.7 ' S. 34.4 

Separate Board - - , " - " , 10.5 .6.7 



Pri^te School ^ 0.8 . 0- 

- .. . ' . ■ • , * 

CAAT ^ 4.7 ' •" ■ . 3.4 

Faculty of Education - 2.1 " 7 6 

: ■ . ■ . / ■ ■ 

OISE ' > 30.8 41.2 

liiiversity 6.1 8.4 

Ministry of Education 3.7 « : 2.5 

Professional Associations . .0.8 0.8'. 

Goyemment / 1.8 - ^" 0 

" ' ' ■ \ ^^^^ 



1 



Business - . , 1.8 y 0.8 



Other ' • 2.6 ■ . 0.8 



11 



EI^ usezs may be foxxtidr piaffing nimeroi:^ roles wi1±iin their 
zations, as can be seen iji Table 5. Administ?ratiCTi and teaching lead the 



TABLE S -■- PRIMARY' PROFESSIONAL POLE 



Role 



Percent 



Year 1 
Cn = 245) 



Year 2 
Cn = ^119) - 



SvDperylslqn - 


27/8 • 


34..5 


Teaching r 


17.1 


■ 16.8 


Pupil Persormei ' < 


0.8 


^8 




J_U • D 


13.4 


Field Develdpment > * >^ 


5.7 


6.7 


Mmistry Regional Office 


■ 3.3 • 


0 


Library 


6.9 


7.6 


Private Consultant 


. 2.4 


2.5 


Undeirgraduate 


0 


0.8 


M,Ed. Student 

i 


3.3-7V • 


0.8' 


Ed.Dl Student 


4.9 / 


3.4 


• * 


> 21. 7 




M.A. Student 


3.7 . - 


1.7 


Ph.D. Student 


9.8 J 


7.6^ 


Other 


3.7 


3.4 



3^ 



13.5 



list, followed by graduate work, field development, and librarianShip. 
Most categories are yisry similar in their representation during the first 
amd second years, except for a marked decrease in usage by graduate 
students. This declinq^ is probably explained by the discontinuiicS-<>^^ 
special programs, to interest students: e.g., a reduced rate of $15 
during the 1975 .Graduate Summer Session at OISE, and the allocation of. 
free searches tof ar niimber of classes. Overall,' though, we feel the prdfile 
of user roles is relatively stable, an^ that administrators will, rfemain- its 
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primry users. Their 'use o£ EISO clearly opens the way for the service to 
have real impact on education: Indeed, that over one-thixd'"o£ ElSO's.iisers 
are atininistrators is probably one of its major accomplishments. 

The drstributidn of users by their .roles in various organizations 
provides some insight into the way their organizations are using EISO. 
These distributions for the project's two years, are reported separately 
in- Xiables 6 and 7. A notable contrast can be /made between users in school 

•boards and those in postsecondary institutions ; including- OISE. . In the' 
fbmer, tisers are'overwhel^^ administration; C^9% oh 'the average^ . 

during EISO's ^irst -year, and 77% in its second. In the latter, users 
are distributed across all areas teaching, , administration, research, 
library, and, of course, gradiiate work. Clearly, EISO is being, used in 
school boards to help -administrators to make decisions, whereas at OISE 

- and other postsecondary institutions it is used as a resource in learning 
*and research^ Determining the inpact from" its lise. in these ways will 
obviously be a long term proposition. ^ . * 

Recognition , of EISO' s usefulness by boa-rd' administrators may/ in 
the end, have- one Tinanticipated consequence: the adoption of the> 
automated information centre idea^or use in their , own boards. This, 
possibility and its implications are discussed further in the last- ^ 
chapter of this report. ^ 

■ To clarify the uses -to which EISO was put -by users playing different 

roles in different organizations, second year users were aslced to indicate 
the role for >diic3i the search was requested. , Table 8 clearly shows that 
EISO is used" for pu3T)oses consistent with the users ^ organizational rol^.. 
In school boards, searches generally were conducted>^r administrative, 
purposes, research or field development, the -latter incliiiiing preparation 
for professional development days, program planning, ^"tc. Only a rela- 

^ tively S3^11 proportion of the usage; was for graduate studies being 
undertaken simultaneously with the users ^ regular eirployment. Usage at 
OISE was concentrated , on research and graduate work,: little use being 
made for the purposes of administration and field development. Library^ 

nskge appeared at an appreciable, though low, level in both school boards^ 
and postsecondary institutions.- The use of EISQ to ^d with: teaching- ^w^ 
surprisingly limited. Though substantial numbers of individuals reported 
their major role ^as teaching, they apparently called on EISO primarily 
vihen they were involved in research.- • 
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■1-TABLE6-" 


■--teim-mBYOE 


< 


R»-1-,USI 

# ■ 


iRS-(N:=-243) — : 

y). 




. ■ Me 




< 

•i 


Organization 








Public Board "Separate Board Postsecondaiy ' 
[n = "78) ■ , (n = 22) ; . ,' : (n=24) ' 


oise' 

fn = 90]-' 


/ inistiy of - 
1 -Education.' 
, • ,&'=11) ^ 


. Other 
(n = 18)\ 


Mninistration or 
. Supervision 


* 53.85 


" ■ 63.61 . ' ■ 


25.05 . 


• .■2.2t' 


V 


/ 16.75. ■ 


Teaching or Pupil 
Personnel'' 


' . ,25.r, 




25;0/ V 


••'14.4 




' 'S-S . ■ 


Research. 


■. 6,4. 


.,18.2 . 


O". ; ■ 


, 13.3' 




:-22.2 ' 


Field Developent 
or Regional 
Office • 


t 

0 




, 0 , 


14.4';': 


' 12,1 . 


. ■ ■ ' ■ 


Libraiy 


10.3. 


■: "4.5 - 


8.'3 


.■ .6.7/. 




. 0 ' / 


^fester's Student 


0 . 


„■' 4.5 


218 


11.1 ,, 


/■.,o;. 


■ i 

^ 5.5 


« 

Doctoral Student 


1.3 


• .• .0 


12.5 


35.6 


. 0 ' 


■ ^ ,: 


Othe; 

■ 


2.6; 


. . 0 .. " ■ 


8.3' . ■ 


2.2 


' 5-1 


. . 44I4, / 

■ J 



I . . . ■ 



Me 



TABIJE7"'PR0KSSm.mBymiZilII0NF0RM . 

""^^ — - ' ^ : ^ — — — 

.. . Organization • ^ .. 

— — • ' — r-- n ' ~ ■ 5 

Public Board .Separate Board ' Postsecondaiy • OISE. ^J^Sn!^ Other 

;fc=33);^ (n = S):. (n=23)_. (nM9) ■ [A-l] 



Adrainistration or ^ 

.Supervision". ^66.7^ 

Teaching oi; Pupil: 

■ Personnel 6.1; 

Research 6.1 

Field Development . • ■ . ■ % 
"or. Regional 

Office' 3.0 

Libriiy. ' : 12.1 . 

Master's student ■ 3.0 

Doctoral Student , 0 

Other . • 3/0^^ 





\ 




4.-'' 




■87.5^ : 




10.21 


66.7i. 


33.'3! 




t; . 0 


14 3 


0 


V 


0 . 


• i 

■ 8.7 


'20.4, ' 

> 


\33.3 ' 


33.3 

J 


r 

O'' 


■ 4.3 , , 


12.2' . . 


0 . ; 


0 ' 


0. 


- "0 *' ■ 


io.2 


' o; 


0 


■0 


■'8.7 


■2.0 


• ' 0 


' 0 




. . 4.3 , 


24.5 


0 


■ • .0 


.0 , 


8.7 


■V.6.1 


0 . 


33.3 



Organization 



Role for lich - 

RequestMade '^i^,^,,^. separate Board Postsecondary OISe'" . ^Sil 

• . (n=-32) . ,(n=8): (n = 23) , [n = 49) , , 

Administration or • ■ , . ' 

Si^ervision , ■ U8?« "12.5^ . 8.n , 2.0,^ 33.31 , 



Teaching or Pupil 



Personnel 12.5 ; 0 ■ '^^l ■ 0 

Research >8.8 ■ 12.5. ■ lU ^^'^i 66.7 



Field Development 0 50.0 ■ 4.3 .2.'0- ; 0 

.Libraiy,'^ • -6.3 - 0' O' , ,10.2 , ■ • 0 

.-Master's Student 6.3 ' 0 26.1 6.1 ■ 0^ 

• Doctoral student 9.4 V' ■ 12.5, , 17.4 30.6 ' < 0 

Other . 3.1 - 12.5 ' . 13.0: '8.2. 0 



Personal Characteristics 

Personal traits as well as organizational types and roles may be important 
factors in determining whether or not an individiial lases the • Educational 
Information .System, for Ontario* In .the firs-f Intevim RepoTt\e discussed 
some of the traits of innovators, and suggested that early users and 
adopters 'of EISO might tend to fit a mold, being more highly educated, * 
more ambitious, and more open to change than those idio would not try the 
service, or who would try it later.- Among the characteristics considered 
here are the iiser's sex, age, education, professional activities, and pre- 
vioias use of EISO* By, conparing^first and second year data, it was 
expected that trends mi^t emerge, suggesting l^iat ElS^O was broadening 
■ its clientele. - : . 

The. percentage of females using EISO has shown a slight increase 
to 35% from 30%, biit the increase is too slight to place confidence in. 
If it does represent a real increase, it could be explained- by the ri^e ' 
in usage by library personnel, most of whom are women (Table 9). 



. - TABLE & SEX OF EISO USERS 


Sex 




Percent 




' Year 1 

Cn = 376) 




Year 2 

Cn = 119) • 


Male 


69" 7 : 




64.7 . 


Female • 


30-3 / 


■J ■ ■ , 


35.3 • 

i 



The change in age distribution also reflects some^ change away from 
the younger category (26 to 35 years of age) toward older categories (36 
to 45 and 46 to 65 years of age) though anomalies occur at either end - 
(Table- 10). The change is probabl>^ due to the relative increased' use of 
the service by those in est^lished careers in administration and research, 
as, compared to graduate stu^nts . This view receives some confiifmation by 
/the .increased pcrceft^age of lasers who have -be'en in their posts an appre- 
_ciable length , of time (Tabie 11)^ . In tMs case f as iA the previoiis two, 
differences, are slight,, but nevertheless represent a penetration of 



EISO service into categories ©£ users -who would be expected to be^omewhat 
slower to adopt the service. ^ \ 



- TABLE 10 .-- AGES OF ElSq USERS 




Age Range 
in Years 


Percent 






" -vr -I 

^ Year 1 
(n = 183) 


Ye ar 2 
(n = 113) . 






. 25 or under- 


2.2 








26 to 35 


' 49.7 


36j^ 






36 to 45 


^ • ' 36.1 • ~ 


42.5 






46 to 55 . 


• • , \ . 9.3 '~ • 


15.9 






56 to 65 


. 2.7 








over 65 


0 


• • 

^ 0.9 





" : TABLE 11 


-- NUMBER OF YEARS m. CURRENT POSITION 




Percent 




Interval in Years 






Year 1 

(n = 184)',,: 


Year 2 -~ ' 
(n = 11<5) 


"; v Less than 1 * 


■■ ^ ;VV'21. 2" " "■ ' -v\--v *-v-' 


^ ; -12 . 9-^^^^v 




10.9. 


'12.1 


■ 2 - . • 


■ * 

■ 9.8 ■ — ■ - 


16.4 


• ■■,-3.- ■ 


11.4/ 1 ■ ■ v.- - 


"12.9 • -• 


' ' "4 to 6 
^ 7 to 9 


• - -,24.5- . ;. 


' 20.7 : . 
13.8 


: r ' 10 or more ^ ' 


■-. .- • ;8^2--- 
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Professional activities «»o£ users reported in the twa years show 
virtioally nd diange (Tables 12, 13, and^l4)'. In both years, 62% had been 



"TABLE 12 r.- OFFICER QE'A Pk<^^^^[AL." OI^GANrZATION 



7 • -Percent 

Response ' ' ' - 



Year 1 v ' . ■ >^ " Year 2 

^n'= 183) ' ^ (11 = lis) 



TV 



I "5 - 

Yes • . ' ; " '- .-<^' " 61.7 

No . : 38.-3 ■ ■ • . 38. 3 



TABLE 15; -- PARTICIPATED IN EDUCATIONAL RESEARCH PRCiJECT 

IN THE PAST FIVE YEARS. 



Response 



Percent 



Year I 
Cn = 185) ■ 



Year 2 
Cn = 115) 



Yes 
No 



75.7 
24.3 



76.5 (. 
23. 5. ' 



TABLE 14, -- PRESENTED A PROFESSIONAL J'APER IN 
THE PAST FIVE YEARS 



Response 



Percent 



Year 1 

Cn = las) 



Year 2 
Cn ^ j:15) 



O ■ 
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Ye 
No 



55.'^l 
47.0 

19 



54.8. 
45.2 



00035 



officeis of professional organizations, about three quarters had partici- 
pated in an educational research project, and slightly over half Iiad 
presented a professional paper in the past five years . Though we have no 
comparatijife data for educators as a whole, we do not consider it too 
unreasonaKle to suggest that the professional activities of EISO users 
are well. above normal. 

The education of EISO ijisers is also no doubt exceptional, with 
. ^pproxiinately 14% holding doctorates and 57% a master's degree, for a 
total of 71% with graduate degrees CTable 15)'. And EISO users seem to be 
deciding in favour of continuing their education. The percentage presently 





TABLE 15 HIGHEST DEGREE 






Degree 




Percent 




■Year 1 
• - . Cn-= 175) 




Year 2 
Cn =111), 



Bachelor* s 


30.3, 


■ 27.0 . 




Master's 


' ' . 54.3. 


57.7 




_ Doctorate ' 


14.9 


14.4" 


\ 


Other 


0.6 


0.9 . 





in or plahning to apply for academic programs leading to a higher degree 
increased from 37% to 46% (Table 16). If -individuals with doctorates were 
removed from the totals these figures would be still higher. Clearly, 
EISO users are -professionals who place an exceedingly high value on educa- 
tion. - 





TABLE 16 


PRESENT OR PLANNED STUDIES 


FOR HIGHER DEGREE 




Response 




Percent 

^. 




Year 1 
Cn = 382) 


Year 2 
■'(n = 112) 
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Yes 

Not Sure . 
No 


, . -37-. 2 
, • 20-7 
42.1- 


\ 46-4 ■ . 
15.2 .: 

, 38.4 000^6 



While a conparison of personal profiles of the typical EISO user for 
e^:^ of the project's two years suggests that some change has occurred, ^ 

— tJiese differences- areTTeiatively^ minors — The -description- of the -average 

EISO user as made in the first Intex*<,m- Report stands. He is either a 
male administrator from a school board or researcher from OISE iwho is in 
his xnid- thirties iaixd is quite active professitoially, is involved in 
research, snd is planning to^ undertake further >educat ion. ^ He is, > in 
short, the archetypical innovator or early adopter • j.^ 

Adoption of EISO as an Innovation / 

What makes an adopter an adopter? Trying somethiiig once? Twice? As vre 
havi^ indicated previously (Chapter VII, first Intev^m Repo^^^)y^^B adoption 
cycle begins with awareness and a perceived need, followed by trial adoption, 
evaluation, andl if the evaluation is positive, adoption. I£ a single trial 
is not sufficient to jiidge the merits-of an innovation or if the decision is 
uncertain, there may of coinrse be several trial xases before adoption or ^ 
rejection occurs. In any case, we l<now that if people are adopting EISO- 
as part of their personal system of information resources, then the 
jiuiribers of repeat users shoixLd be increasing. ^ 

Awareness' of EISO among educators has been fos;tered in numeroiis ways , 
including mailing of many brochures, presentations at meetings and. con- ^ 
ventions, class instruction, etc. How tisers became aware of EISO is - 
another matter. As Table 17 indicates, some techniques worked (e-g- , . 
- direct mkil brochures) 'and others .did not ; (e . g. , articles and advertise- ^ 
ments). One of the most effective disseminators of information about 
EISO has>een the reference librarians in the OISE Library, who, on their, 
own initiative, effectively made i^ a policy to refer people to EISO. When;^ 
ever they thought it might be of assistance in meeting the individual's 
infonnation' needs. Similarly, colleagues' recommendations have been a 
-major factor in creating awareness about EISO. #iile this type of dis- 
semination is beyond direct control, an attonpt to maximize its effec- 
tiveness was made by selecting" key groups for EISO demonstrations. 

Awareness of a service is not sufficient to motivate the lose of a 
new service, however. Something more is needed -- a pinpose at hand.y . , 
The purposes that helped to motivate EISO users, reported in Table 18 
grow out of the organizational roles and personal ambitions that users 
hold. The graduate student rieeds information for teim papers; the active 
•nmei^intendent for program development; and the OISE professor for research. 

ERIC ' ' .^^ eoor*7 
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Percent 
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Method 








Cn = 384) 


Year 2 
Cn = 118) 


Brochiire 


35.7 ' \ 

1 


30.5 


Article or Advertisement 


1.3 . 


' 3.4 


Professional Development Day 


0.3 


0 


' Class Instruction 


6.5 


4.2 


Colleagues 


33.9 . ' 


' 23.7 


EIC 


5.2 

• 


2.5 


u 

Ldbrary 


2.8 


16.9 


EISO ^ta£f 
' Other ^ 


n/ai 
13.9 


.8.5. 


^Not a respOTise on Version A o£ User Evaliiation Questionnaire. s 


TABLE 18 -- 


PURPOSE OF SEARCH ~ 






. . Percent 








> 


Purpose . — r- 

V 


Year 1 • 
Cn = 386) 


Year 2 
Cn '= 119) ' 


Term P^er 


31.3 


24.4 ■. ■ 


Bibiiograj>hy . 


-3.6 '/ » ■ 


3.4 


Curriculm Development 


7.5 > . 


12.(5 


Program Iijprovement ' . 


12.7 ' 


16.0 


SpeecJi or Article 


2.8 


4.2 - 


Research and Development Report 


28.8 - 


24.4 


Browsing 


2.1 


• 0.8 


^•^.^P&rsOTnel or Recruitment 


2.1 ; . 


.1.7. 


Policy Development . 


6.7 - 


10.1 


Other . 


•■ --2.4 


" 2.5 



er|c % 



A conrpariscm of the puiposes motivating searches in the two years shows 

( ■ . ■ 
_a_decrease--in.d-ts--xise- ^or -sl^udent-term 

for professional matters like curriciiium development (iip to 15% from 8%), 
program ijuprovement C^P to 16% from 13%) and policy development (up to 
10% from -7%), '-These chmges are of si^Dstantial practical importance since' 
they -reflect an increasing lose of the • information obtained for making 
y decisions about the educational systeml 

. - Being aware of EISO and having a purpose at hand, the- user next 
cxmtactS' sdmeoi^with access to the system. , Most users contact the search 
analyst directi^S as Table 19 suggests. In fact, among those returning \ 

' ~~" ~ ^ ^ — — '-■ — 

■ . TABLE 19 \-- TVHO ASSISTED IN FORMUIATpIG SEARCH REQUEST * 



Role of Assistant 



Percent 



Year 1 
Cn = 382) - 



4 



Year 2 
Cn = 11?) 



Search Analyst. • 
Field Centre *Eie 
Faculty of Education EIC 
Ministry' of Education EIC 
CAAT EIC . . 

Not Sure 

-Other ' - 



85-9 
7.3 
0.5 

J., 6 
0.3 
1-3 
3-1 



98; 3 

/ 

' 0 
^ 1.7 



0. 
0 



questionnaires, there, has been a signxficarit decline in the "use of EICs ' 
in the Northeastern Region. tJVhether this decline , reflects the e^diaustion 
..of free seardies in the area, a changing of the EIC role into more of a 
referral service, or simply a poor return of questionnaires, we cannot yet 
say. However,, discussion with the search analyst and -EICs suggest that , ' 
both the EIG and search analyst may be involved formulating a search 
request, albeit at different stages. Gdntact wi^h the search analyst is 
ma^e by phone, mail, or in person (Table 20). . * 

. Having conducted a search and acquired material, the user will need ^ 
access to a microfi^e reader if some of the materials are ERIC . documents ' 
EF(iC1^5*^fiche. ^ About three-quarters of the . respondents had' these^^^^^l|^e 
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CONTACT 




Mode of Contacf 




rercent 






Year 1 . 
Cn = 385) - 


- 


Year 2 
Cn = 119) 


»In Person 


i 

■S2,7 




^' 52.9 • 


Telephone 


32.5 




.29U" 


Mail 


14.8- 


\ ■ 


-^Tt^ 6 -> 



but only cme- third had access to a portable fiche reader ^CTables 21 and 
22).^ Even so, the latter figure is a marked increase from the 11% ~ . 
reported in the first year. We suspect that the availability of micro- 
fiche' readers particrilarly portable readers, represents an organizational 
xronmitment to the use of microfiche and may be a good index of an agency's 
innovativeness with regards to new forms of information. In an assessment 
of the correlates of repeat users of EISO, the availability of a portable 
fiche r^er proved to be one of the few statistically significant pre- - 
dictoTS of who would become a regular client. 





■ ; TABLE 21 


-- AVAILABILITY OF MICROFICHE READER 




Response- 




Percent - . . 




Year 1 - 
' Cn = 382) 


;Year 2 
""Cn = 118> , 


1 


Yes . . 


■ V. 


■ " ■ . - 73.7 . 




Not' Sure - 


, ■ 3.4^ 


- 5'.9 ' - :. 




No 


J ■-. - 

• ; 11.0 


.. . _ 20.^3' • 


o ■ ' 
ERIC' 


> 


' 24- • 





■ V 

a'- - table 22 


— AVAILABILITY OF PORTABLE FICSE READER . 














Jrerceiit; 




Respcjiise 








- Year 1 ♦ 
■ (ri = 382) 


> • 


Year 2 
^(n =113) 


Yes • 


=$^•4- -11.0 


■ ■ 


35.-4 ' . 


. - Not Sure 

No -. 


- - . 89:0 ( 




24.8 
39.8 



^^Questic^a phrased in -dif£eTC way oti Versions A and' B o£ User Evaluation 
Questionnaire^ * . . / , V 



The overall likelihood of repeat iise is suggested in Table 23, which 
reports the percentages of searches con5)leted for, individuals who had . 



TABLE 23 


NUMBER OF' PREVIOUS EI SO SEARCHES 






Number* o£ 


Percent 






Previous Searches 


Year i 
- , Cn = 386) 


Year 2 '. 
Cn = 119) 




^- ; None 

• » ' * - 


69.2 


60.5 






15.8 


15.1 




2 


4.7 ^ ■ . • 


9.2 






6.0 -. 


ip.i 




6 or more 


. ■ ■ 4.4 . 







previously^ conducted ElSO^searches. Overall/ there is, as one would 
expect, an increase^ in those reporting a number o£ previous searches. . 
These figures are in fact conservative since EISO decided to stop sending.; 
* evaluation questionnaires to usei^ who had cornpleted five searches in ^ 
order to avoid placing too great an imposition ijqpon them. At a later date, 
<3ata on numbers of searches will be recovered from search request forms tov 
provide a more accurate coimt. , I , _ - , 

/ 25 . ^^^^^^^^^^^^^^^ '^ 



- I£ one assumes the cautiotis view that not until .the .third search 
hks a user become an adopter, then it can be fairly stated -that a quarter 
<4£.EISP searches were conducted by adojiters during its second year. Case 
studies have- been made of two EISO adopters, one in a school boa±4 and one * 
in a' government agency. Ihe first, Mr. Bob O'Neill, is a si;55erintendent 
with the London-Middlesex Separate School Board. His experiences were 
recounted in an article that appeared as an "Admirmovation'* in OCLEA 
(.Appendix C). Mr. O'Neifl exhibits many, of the traits detailed above as 
being typical of innovators and early adopters, e.g., a male school 
. administrator with a master^s degree. lii addition, Mr. O'Neill was already 
a regular user of ERI^ materials and had his own' portable fiche reader even- 
before EISO begai:' providing conputer' access to ERIC. As a result, he was - 
-^able to inak-e/|jnniediate iise of the service, and was one of its earliest . 
adopters. . - " ^ - - . 

-Another adopter is Dr. Jane Smith '(^ fictitious naine) "uiio is e^loyed 
in a government agency. Her experience x>n-th her "first search is described 
in "One User^s Experience," Chapter VI of the first Inte2>im ReipoTt^ Dr. ^ 
Smith gave the first search- a satisfactory review, was impressed with the 
service, and lias returned since "to do two additional searches^ She is 
hig^y educated, and involved in research ^d policy 's^tudies, characterise ^ 
tics that help to inake her an early adopter. . , - 

The. home organizations of repeat users can be inferred from Table 24,- 
which presents ^e average search .xruiriber for members in different oi^aniza- . . 
tions,, The hi^er the number, the more times individuals from the type of. 
institution named liave conduct^ i;epeat searches... EvidOTtLy,',t3i^ most 
regular EISQ. users are from school boards 5 where thfe mean seardh number ' ' 
for public and .separate boards coni^ined was 2.51: ' This is':\- ^ 

promising, since it. suggests that a regular clientele from sc^^ boards^, 
is being, created, .. .a clientele that 'xould become an ip^portant^^ - ^ 

EISO's. wider use.; \ / - ... 



TABLE 24 AVERAGE NUMBER QF PREVIOUS SEARGEES BROIOEN 
: DOWN BY. ORGANIZATION FOR SEC0M3-YEAR USERS - . 



Organization 




X 




s 


h 


* Piiblic Board 


1. 


• 

.03 


2. 


14 . 


■ "33 • ■ 


• Separate Board 




.63 


8. 


28 . 


r ■ 

8 


. " Postsecondaiy 


0. 


.09 


.0. 


29 


23 


Ministry o£ Education 


1. 


.00 - 


• 1". 


00 V 


3 


" OISE 












Academic . 


0 . 


.82 


1. 


10 


..■ 33 


, . Research and Field Development 


1- 


.73 ' 


1- 


74 


11 : 


/ Library " . - 


,1. 


.60 


1- 


82 


■ s ■ ■ 


■- .\ Other ■ ' ' . ■ . .. . ... 


0. 


67 


0.- 


16;.- 


-3 : 

r 



Test o£ Significance : = 10 • 56 ^^,01 Level 



■ V ' . • Conclusion - ^ " _ \" 

ElSd users :represent a cross-section oif Ontario educators . They CQi^e £roni 

all parts q£ tihe prbvirice, are meiribers of . diverse educational: organiziatiotus.^ 

and have niany^ d^^ roles . . If a goal of EiSO Was to make educational 

infoimation widely available, it has certainly succeeded. 

' ' ' Relative "to population, ; the areas most heavily represented aniong 

EISO^s users are the Northeastern Region of the province and Metropolitan 

Toronto. Ihe pre-enrinence -of the first arfea is explained by the extensive 

pi^^licity, provision of trained Educational. Informatidri Consultants and 

allocation of free searches in the region. . The large number of us^rs from 

Toronto," on the other hand, is probably due to the proximity of the users 

to EISO and the conc^tration of educational researchers in the. city* 

ScJiool boards and. OISE each provide about 40% of EISO* s users y vri^t^^ 

the remainder coming fx om the JfyGnistry^ ^of Education, " CAATS", faculties of 
' . " , '^• 

.educat'ibn, etc. In conparing the distributions of clients V organizations 

- ■ ' , ■ ' . ^ 

reported during EISO^s first year with that o£ the second, a trend toward 



a greater percentage o£ users from imiversities. and facilities o£ Teducatian 
•was-iK>ted, J.--- . . S . • 

- -Approximately CHie- third o£ EISO' s clients vie^ administrators ; - 
teiachers, researchers and graduate students each represented one-sixth 
b£ the total* The majority of users in school boards were administrators, - 
followed by teacher^ and librarians r Those dErqm OISE tended to be either 
graduate students, who formed about, one* third- of the' OISE >"users ^ or indi* • - 
viduals involved in research, Afield develqpment, or the library* 

Most users x<mducted searches which were related to their primary 
professional role. Hew users from school boards, for exaii5>le, reqiiested ^ 
EISP searches for conpleting term papers or dissertations required as : ' 
part of graduate studies in v3iich they .were involved. Overall, about ^ 
25$ o£ lie searches were conducted for term papers, 25% for^researdh and 
development, and 15% each for cxxridcixltim developingnt,. program iii5>rovement, 
and policy .develq Over the two years^ the .use of EISO for prof es- X 

sional purposes^ increased, a trend largely due, to the decrease in its use 
by graduate students. . ' 

The typical EISO user was a man between the ages of 36 and :45 i^o • . 
held , a master* s degree - and liad been in hxs present position "four to six/ 
years.. In all probability had been an officer of a prodfessional prgani- . 
Zation and had been involved in doing research. Chances, were about even 
that^iie had prepared a professional paper in 'the past five years . > Ihis ^ - 
profile is . v3rat- j^oiild be, expected for an early adopter of aift educationaJL . / 
..^innovation. • -v --.'j '•■ ^s " ■".•-.r'.-- 

The averag^ user first became aware of EISO either from a colleague' 
;or from ail EISO brochure. /Increasingly have been referred to EISO 
by libraries, especially the QI9E Libraiy. About half of the clients 
contacted the search analyst directly when requesting a search ^ one^third 
phoned in their reqiaest, and ttie remainder used the mails. i\bout 40% of 
all searches were -conducted for individuals viio had use^ the service at 
least once before. 

Finally, three-quarters of the users reported that they had access : 
to a microfiche- jreader; orfe-half had' access to a poTt:able.md.crofi.che 
reader in the second year. The latter figure represented a considerable 
~incn:ease over the preceding y suggesting that microfiche equipment 
is becoming more readily available. ' ' \^ ' , " - 

. . The major conclusion that can be drawn from this overview "of the . » '' 
users of EISO was made ."in. the: opening paragprapl^ 



reaching a 'Br^d cross- section of educators in Ontario. These users appear 
■'''to be makings use of tKe service in Ways that iiad^be^ anticipated ^- for - 
program "development curricjilim planning, researoi j and term papers . 
Clients from board^. it is iirpdrtant to note, are -using the service to " 
help them' sojve board problems,, not to assist. them iji outside professional, 
course work^ ' . . . / 

At the same time ;^ it must J^e acknolwedged that renewed efforts must 
he VDdQTta^^ from school boards . . "While advertisanents, 

articles, an^ not^ been particularly effective in 

attracting user^,^ and word- of- mouth among colleagues 

have been* The*, latter .two -modes of informiag users abptrt the service 
EISO provides should -be emphasized in the future. 

..Much of the effectiveness of dissemination of information about EISO 
has been done by satisfied users. assessmen^of the level of satisfac- 

tion expressed by* the ' average User is thb topic of the next chapter- . 
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Levels af Satis faction Anong EISO Users 



Every user condiicts some sort of personal assessment of ^ISO and its. com- 
ponents* This evaluation xs one of^the stages of the adoption model but 
it also occurs every time a seard^^^j^^ conducted. EISO contipuoiKly moni-- . 
tors its clients^ reactions by requeifcing them to conplete a number of 
items on the EISO User Evaluation Questionnaire. : 

Results conceThing the levels of satisfaction for users during ^. 
EISO*s first and \^econd. years are provided in this ch^ter. Data are 
presented both araiually and broken down by month in order to assess any 
trends* Analyses for both scales and itemsk. provide a good insight into 
the strengths and wealcnesses of EISO^s sermce/ Before proceeding with 
these analyses, thoug^, we shall deal wit^ a technical ite^ the relia,- 

bility of satisfaction scales." V 

•♦. . . ■ ■ ■ ' - . - 

' ^Reliability : %>me Comments - - , 

Msasirrements of all kinds must be reasonably precise if they are to be 
iisefcl*. Th^ Statement holds Spr the measurement of psychological/vari- 
ables^ kike satisfaction as mueh as it does for physical mieasures like 
lengtii, though the determination of reliability [is more dif fiLcult for 
the fbrmer than the latter. For exanple, the l^gth of a 'room can be • 
^ measured several times and the resiiLts might be expressed as 3 metres . 
±2 centime ti:^, \^3lere/d: 2 centimetres represents the error in measixremerit* 
hew does one assess the reliability 6^ ah at titudinal measure? 

Repeating a measurement, as in the preceding exan^ile"^ is one method 
of determining reliability that is used for psychological as well as 
physical measurements. However, for scales sucdi as the six satisfactioix 
subscales used in this study that relate to the user's level of satisfaction, 

EB^" . . //■•'so..; ^-r- ■.' ■ ■ -^^ ^.OG046 



reliability is more often determined by assessing a scalers internal con- 
sistency. That is, one asks the question. Does the "reading" from item 1 
ag^ree With t^ "reading" f r om item 2? If so,' then the scale is consixiered 
to be internally consistent, and hence -reliable. "In- a sense, each item of 
' jSL scale serves as a measiire of the same characteristic, such as a' person ^s 
satisfaction, and in using a scale of several items, several simultaneous 
measurements are ^obtained, ' i*e* , several, repeated measures. . 

Reliability is normally expressed, in terms of either a reliability 
coefficient or the standard error of measurement. The nearer the relia- 
bility coefficient is to its maximum value of 1, the: greater the relia- 
bility of the scale. Expressed as a percentage, it represents .the amount 
of variation in the measure which is "true" as opposed to "error" varia:- 
tion^ Subtracting the coefficient from 1 provides an estimate of the 
piroportion of variation due to error (i.e., 1 - r^^ where r^^ is the 
reliability coefficient) . If the total scale variation is V-t, then the 
error variance is given by Ve = YtCl " ^tt^ > and the standard error/of 
- measurement is the square root of V^.'^' That is, S.E.jjieas-X ^ yrhere 
X is the variable whose" reliability \s being assessed. 

The particular method of coirputing an estnjnate of the reliability 
of satisfaction scales used here is that of Hoyt (Kerlinger , 1973, p. 452), 
vSixch uses analysis of variance: to test , a scale's reliability. However, 
one- .problem arises with this '-and other measures of reliability: they . 
. depend on the existence of true variation, in the , measure in question. 
■ If, in feet, no -variation is /present or it i^ . extremely small , then, the 
reliability will. be 0 or near 0^,/ as can be seen .dFrom the formilas above. 
This problem is quite seriotas, but . can usually be overcome in psycholo- 
: gical testing by including increasingly difficult items in order to 
.spread scores over a greater range . ^ That this solution sometimes results 
in tJie incli2si<^ , of trivial or eso^^^ items is not iir5)ort^t in terms 
of the test's reliability, though it may create grounds for questioning 
its validity. The problem of small or 0. variation is not so easily solved, 
however, when the actual distribution of scores is. relatively compact, -and 
the scale cannot be stretched by adding more difficult items. . In thbse^ 
cases, the reliability coefficient may be_ low not /becatise the scaie is . 
inherently unreliable, but because the population being measured lacks 
appreciable variation among its- -members . • An alternative assessment of 
a measurement's reliability useful iii these situatiOTis can be made by - 
. comparing its standard error , of measurement with the range of potential . 



. ysuriation the sqall^ exhib^ For exanple, assume that ' a scale range 
is three points, where 1 — dissatisfied, 2 => satisfied, and 3 = very 
satisfied, and that .itSL standard error is only .15. ■ Even if the scale 
has low reliability, the ratio o£ the standard error to the. scale's range 
is so great (namely, 20 to- 1) that we can have confidence in "the scale * s 
precision. And such a .sittiation is not far fetched, but would occur 
wh^iever a ver>^ large proportion of the population made the same response, 
e.g., vety satisfied- 

The problem created by low' popiilation variance described above was 
observed repeatedly for^iepisures of EISO users' satisfaction* In iiiany - 
cases, virtually all respondents reported a very high degree of satisfec- 
tion, and hence little^ varia.t ion was observed. For example v 'vjhen aslced 
about their satisfaction with the helpfulness of the search analyst or 
the Educational Infoimation Consultant, those using' EISO -during the period 
frOTi July 1975 through i^pril 1976 were overwhelmingly positive: 91% 
reported a. high level of satisfaction; : 14% a medium level; and 2%, a law 
level* This item plus tl^^o others foxTnqd the subscale jneasuring user 
satds faction with the "Quality of Service," and aXl three items' exhibited' 
low variation. As a. result, this scale's coefficient of reliability can- 
not be taken as an ^adequate estimate of the precision of the measurement. 
This must, be determined by contrasting the scale's standard error vrithT 
the scale full range. ^ . . 

High reliability for measurement scales, while always of value, is 
not as necessary when one is concerned with groups raliier than individiials. 
The average satisfaction of EISO users is a groi:^) ^aracteristic, rather 
than an individual ' trait . It is based on measureir^ts taken on a lai^ge 
number of individuals, and as a result it can be estimated more precisely 
than- the satisfaction of an individual person. In psychological testing. 
*v3iere individual assessments, are being made, a test must be so reliable ; 
that J list one .measurement is sufficiently accurate. Fortunately this is 
not the case for this: study* - - ' 

: The best measure of reliability for the group average is the stan- 
dard error of' measii^ement . for the mean. This standard error, 'which differs 
,from the standard* error of X, is. given by S.E.j^^^ X ^-^-meas^X /• wher 
n. is the sanple size. Clearly, the sanrole size is an •iiiportant factor in 
ensuring, a precise estimate : the. larger the n, the smaller the standard . 
error of measurement for the. mean. Thus, "even when a scale is not par- .. 
ticularly reliable in and of ijtself , a reliable -estimate can be obtained 



for a population mean by ensuring a JLarga sample , is obtained. 0£ course, 
a large sainple size also reduces the uncertainty or error due to s'anpliiig; 
variation, -/ . • 

. ^ In the presentation o£ reliabilitxes for the satisfaction scales 
that fblibvr, the various points /made in this discussion are o£ considersable^ 
in^x^rtance. Though some scales revealed little variation aid h«ice had ^ low 
•reliabilities, this, lirnitation' is offset by the small size of the error 
vAien judged against the magnitude of the scale, and v5ien the groi:^) mean 
is the measurejnent whose precision is of interest • ^ * - 

- Reliability of Satisfaction Scales ; - 

In ^ all, /five siibscales were used, to measure user satisfaction with different 
facets of the Educational' Information System for Ontario: Publicity - 
Materials and Directions, Quality of Service, Timeliness of Services- 
Quality of Technology, and Value of Bibliographic l^terials (see Table 25). 
In addition , a coii^MDSite scale was used to assess the Overall Satisfaction. 
The latter scale is the 'sum of six items tapping six aspects of the serv- 
ice to which all users 4were exposed aind could therefore validly assess. • 
Kesponse rate for these six items was very high, thereby providing s. . \ 
large sanple ; dEbr computing a reliability estimate. The . sum. of all the 
15 individual items . used on the five subscales* was not used for this 
overall scale since in some cases only a small nunber of users had. 
utilized a specific aspect— of the service, e:g., ordering microfiche 
copies^ Ifed all items been included in the overall scale, the overall . 
assessment could only have been based on the small number of users \Aio 
had exploited all, features of "die service. ■ ' V 'i 

.. The reli^ility and standard errors of measurement for the six 
scales are, reported in Table 26, together with descriptive statistics 
'(mean, standard deviation, and, number in sanple) . All estimates of 
reliability -are based on EISO users who requested, searches between .July ' 
1975 and -April 1976, and' idio responded to all items oii feach of the scales 
in question. ^ . 

' ; • Table 26 indicates . that all but one of the six: scales are sufficiently 
■ . • ' ■ " ' • ■ - ■ ■ ' " •■ 

reliable, for one to. be- -confident of the results. Reliabilities in descend- - - 

ing order are as follows: Publicity Materials and Directions , • <80; Value 

of Bibliography,' . 79 ; Timeliness of Service, .78; Quality of Service, ^ .62; • 

Overall Satisfaction, .SSr^and Quality of 'Technology, .27. Even for Quality 



TABLE "25 SATISFACTION SCALES AND ITEMS BY YEAR 



Aspects o£ EISO 



Year 1 



Year 2 



Publicity Materials and" Directicois 



Accharacy 6£ jniblici^ materials-,' 
EISO presentations , etc . 

CcOTprehensiveness of i)i3blicity 
mate^rials, EISO presentations, 
"etc/ 



Accuracy and conprehensiveness o£ 
publicity materials 



•Adeqiiaey o£ directions £6r sub- 
mitting search requests to 
EISO r. 

Adequacy o£ directions for 
ordering copies of materials 



Convenience of arrangements and 
and adequacy of directions^ to 
obtain EISO searches 



Adequacy of directions for order- 
ing copies of materials listed 
in bibliography 



Quality; of Service ' 



Convenience of arrangements to 
obtain EISO searches - 

Helpfulness of search analyst . 
or Educational infori^ 
Consultant 

Time devoted to searcii inter- 
view with search analyst or 
Educational Information Con- ' 
sultant 



Convenience of arrangements and 
adequacy' of directions to obtain 
EISO search^ 




Helpfulness d£ search "^aoMl^rst or 
Educational InformatxOTi Consul- 
tant ■ / ' - 



Time takCT. to 4eliver the EISO 
bibliography 

' Time taken to deliver micro- 
fiche or paper copies ordered 
from EDRS in- the U.S. , if 
. applicablev - 

Time taken to deliver microfiche 
'or paper copies ordered from 
EISO : ' ■ 



Timeliness of Service * - . ^ . • 

' Time taken to deliver the EISO 



bibliography ' 

^ Time : taken^ to deliver -jnicrofiche 
or paper copies ordered from 
EDRS 

Time taken to: deliver microfiche 
or paper ■ copies ordered from 
EISO " 



ir 



cooso 



TABLE 25 CCbntM.) 



.Aspects o£ EISO; 



Year 1 



Year 2 



Quality of Technology 



Length o£ bibliography 

Readability of microfiche copies- 
if ^>plic9ble 

^Availability o£ microfiche 
^readers 



Length of bibliogr^hy* . 
Readability of microfiche* copies ^ 

Availability of microfiche readers 



Value of Bibliograj^hy^and IVIaterials _ 
Value of bibliography itself Value of bibliography itself 

Value of materials located via ' V»ue of materials located via 



EISO bibliography 



:ISO bibliogr^hy 



Overall ■ Satisf acticm. 



ConvCTiiencei of. arrangements to 
obtain ElSO search ' 



Time devoted to search , interview 
with search analyst or. Educa- 
:/tional Information (^lonsultant 

Helpfulness of search analyst: or 
Educational Information Consul- 
tant 

Length of bibliography - 

Value of bibliography itself 

Value of materials legated via 
■ EISO bibliography 



Convenience of arrangements and 
adequacy of directions to obtain 
EISO searches 



Helpfulness of search'- analyst or 
Educational ]jifoinnation Consul- 
tant . , 

Length of bibliography 

Value of bibliography itself 

Value of materials loca^d via v 
EISO biblipgr^hy 
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r -f. C T| , - • S.E, ' . S.E* ^ 

Scale • , X T ^U' . m^as.X ' measJ 



'Pliblicity.'Materials and Directions 88 /2.57 ' ' , l.OO'. ■ ' O.SO"- ' '0;39 

. V, 



X/ 



• Quality of Service . . . 200 /-2.81 0.60 ■ 0.62 O J . . ' 0.02 

' ■ ■ • ' ■ ' . ■ i . .. ■ ■ 

. Timeliness, of Service . ■■25/ '2.31. -IM^ 0.78"' .0.42 0.08' 

Quality of Technology ^ ' ■; 56 '■■ ■ 2.42 ' 0.76 0,27 0.54 '•■ ■ .0.07 



■■ ■ -. : . ... r ■ . 

Value of Bibliography and Materials 133 ',. 2.24 , . 0.87 0.79., : ' 0.28 0,02 

■Overail Satisfaction, ' 180 ' \^ ;, 2.61 ' ' .0.79 0,58 ' 0,47 .■ '0.04 



'•■■.%yt ;est3mtes of reliability based ^ requesting searfc between July' 1975 and i^ril 1976. ' '\ . . 

■ . .... ^ . . . ' . 

^Sanple size for, subsaiple f()r which coflete responses were available. Total population was n,= 387. . • 

• . '''Scale totals haw been adjusted for mki of items to provide means., standard deviations and standard errors. . ' 
; on original thre^point scale: 1 = low satisfactim, .2 = medium satisfactitn, and 3 = Mgh/Satisfactim; ■„ 



o£ Technology, however^- the measurement "error .for the mean is ^small,/only 
• •07> This valTje provides a sufficiefi^tly precise estimate^ of the mean for' 
lis to infer w^th" confiiience that - there moderate level of satisfaction 

. with -the technological 'aspects -of the service; i.e., with the readability • 
' o£ inicn:p£iches, length of^ the "bibliography, and the availability of micro- 
'fiche readers*. item analysis of this scale carried out to uncover tjie 
cause of the scale's low reliability showed that the three* items l^d cor- . 
relations of CTily 720, .15, "and .09 with the subtotals based on the 
./ opposing two. items. All correlations are small, thereby indicating that 
eac±L* item has - lilHtle in " common, with the other twp^ ^ It would appear that 
the items measure-, in e^ssence, individual characteristics of the EISO* ' 
service, that are relatively unrelated to one another. ' . \: 

The reliability of the Overall Satisfaction scale , . though adequate, - 
- is ;6Qpiewha:t lower than might be. preferred. -The 'contact, positively- 

skewed distribution of scor^^account for this; sitxiation (see Figure^ 2}. .\' 
. Item analyses indicated each of the six items cn the scale had a positive 
correlation of between .-23. and .46 Cvarlues significant" at- the .01 level) 
with t3ie -siib total based on remaining scale items.: That is, all were ^ ' 
good items and^-cadtributed . to tlie scale. . Also,-^1ihe large saniple size 
uakes .the- estimate of thel*ayerage Overall "Satisfaction veiy accurate. 

" Trends iri Levels of -User Satis faction ^ ' ^ 

..... " - . ♦ ' ^ ' • ■ \^ * 7^ • 

Data 'sTiowing the client'^s satisfaction with the Educational Information 
Siystem for Ontario and the. materials it provides have 'been collected for 
a period of sixteen mcgpths spanning two years of operation. This section 
analyses 'these, data -in order to discern i£ any xdiariges have occurred^ and 
to establish -reasbrialple standards for performance. First, data are^^broken 
' -down by year and then by month, with satisfaction scale means being treated 
first, followed by ;the analysis of item means. Subsequently, graphs por-/ 
trayiiig trends on ^ monthly basis are presented, again. with scale means 
analysed ^irst and item means, second. . 

Conroarisbn of Yearly Averages \i 

First and second year users'' average \Level of satisfaction with EISO^s ^ 
; five dimensions are, reported inv Table 2^7,. which indicates that there is • 
no appreciable difference in the ^ervicfe.'s effectiveness over the two^/^ 
years. ChanEles in averagd*- levels of satisfaction ranged from an increase 

. " . V ^ ^ ; ■. -37' ■.■■;r;-. ■ C0054. ,■ 



,M 27 -- SATISFiOIQN. SCAI£ ' MEANSj^STMlD^^OT^ M FRHJUENCIES^ 



Satisfaction 





. Year l- 




. Year 2 




t ' : 


■ Signif iciice 




l 


s 


n 


/'I ;S/ 


n ■ 


-J 


• ■■" ■ ■ \ 

Publicity menais ana uireeuons 


"2.57 


■ 1.00 


88 


2.53 0.44 


101 


' -0.481 


•■ n.s. 


UUcliJlw vi OClVi^w 


2.81 


0.60 


200 


2.73 0.38 


108 


■1.205 


n.s. 


imieiiiiess 01 jervice 


2.31 


1.09 


■ 2"5 


2.37 0.47 


17 


."0.234. 


n.s, " 


(jiiaiity of Service 


■2.42 


» 

0.76. 


56 


2.46 0.39 


43^ 


, 0.317 ■ 




■/ 

Value of Bibliography and Materials 

• 




» . 

0.87. 


133 ■ 


2.21' 0v72 


88 


-0.241- 


n.s. 


Overall Satisfaction 




0.77 


180 


2.55 0.35 


,95 


■ .',-0.754, 


n.s. 



iScale iwiis relate to a fiiree point scaj:. 3 = hi^ satisfaction, 2- -Mm satisfactira, andl =:loi( satisfac-;; 
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of ..06 for Timeliness of Service to a decrease of -0.08 for Quality of 
Service, neither of vSiich is statistically significant,. Overall Satis feC' 

^ tion., too, did not exhibit a statistically signficiant difference from the 
previoias yeair's level. Thios, the average user'perceiAred EISO as providing 
a consistent level of "Service over the two years. Further, users espressed 
a high level of Overall Satisfaction in the two years . That is , in both 
years the average was in the 2.5 to 3.0 range" on the three-point sc^e 
being used, ffi-gh levels of satisfaction were also expressed for Publicity 

' Materials . and Directions , and Quality x)f Service. . Medium-high levels of 
satisfaction- fin the 2.0 to 2.5 range) were expressed for Timeliness of 
Service, Quality of Technology, and the Value of Bibliography and ^fe.terials. 

■ The last of these is, in the long run, probably the most in^jortant dimen- 
sion since it refers to the system's output. More detailed presentation 
of responses; to this item is given in Table 28, v^ch reports the percen- 
tages v4io expressed high, medium, or low satisfaction with the Valiie of 
Bibliography andJMaterials. j^^proximately half of all users in '^th years 



TABLE 28 -- PERCENTAGE DISTRIBUTION FOR SATISFACTION WITH 
QUALITY OF BIBLIOGRAPHY AND MATERIALS BY YEAR 



\ ■ . \: ■ i Percent'^ 

Level of - ' - 



Satisfaction^ 


• ■ Year 1 


J ■ Year 2 




Cn = 133) 


Cn = 95) 


' High ' 


45.1' 


47.8 


Medium . \ 


45.1 ^ \ 


, 35.^ 


Lcfw 


9.8 





^Classifications -are: as follows:- High, 2.50 or 3.0; Mediijiii, 1.5 or" 2.0; 
and Low^ 1.00. , 



vere highly satisfied, an addi^onairthird indicated a ininiinum level o£ 
; satisfaction, and the remaind^Fa low level. ^ Put another way,. ^ 85% oi^all 
clients were satisfied with the quality of EISO^s output;.' , , 

Even though the analysis of responses to the five rating scales indi^ 
cates that service has been . established and maintained at a higji. level over 
twciiyears, more detailed analysis of -responses on individual scale items " 
is warranted in order to focus on specifics (Table 29) Only one item . ; 



* 



TABLE 29 -■ mFAClTON 111 MEANS, SIMIAED. DEVIATIONS Al^^ 



■ V 

, • Satisfaction 



Scale Itei '■ ■ ; Yearl Year 2 ^' ' Significance 



X /,s n -l s \ n 



Mlici'hj M2tem'ls and Hveetions ■ , , 

..Acoiracy andcdprehensiveness . ■ ' . 

■ • . of publicity materials : ■ .2.45 0.66 112 2.37 0.62 105 / -1.03 ; • .n.s. 

Adequacy of directions for . ' - 

.submitting seardi'iequests^ . 2.68 ' 0.55',, 143 ' ' - . — ' 

' Convenience of arrangements and 

adequacy of directions^ ' ■- ■ -- 2.70- 0,47 ,114 ' ■ - , 

*Adeqaaqof directions, for order- • ■ ' ' ' ■ 

■ ; ing. copies of materials "" ' 2151 0.6J 182 2:51 0.60\ 108 : 0 ' ■ ■, n.s. 

Qmlitij ofSeToice \ . ■ : , •. ■ 

■ tJonvenience of arrangements to. ■ ■ 

obtain- HlSOseardiesi 2.84' 0.41 23-7. -- -■ 



(biipience of arrangements and 
:vadequacy'pf directions^- 



2.70 0.47 114 



Helpfulness of.Searqh Analyst or ' ■ .' - , ■ ■ ^ 

'nC. .. 'V.., 2.88- 0.37 125, .2.77 0.50 ' 112" -i34' ..01 

TijK devoted .to search interview^ 2.71' .0.58 208 . . h ^ 



ME 29 (GQQt.d] 



Satisfaction 



X s It- I ' :S ■ :n'- 

^ — — 



S^I*™ tell V Year2 • ' i ■ 



Iff* 

: .TiMlimss of Sewiee , ■ • ' 

■ ., , , , . , , . : ; , ■ , ■■ ■ ■ , - ■ y 

Time taken to deliver biblio- . . , • " ^. 1 

graphy > 2.64 0.6,3 224 ' . 2.55 0.62 116 , -1.26 n.s. ■ 

Time taken to deliver, materials . 

: from-EDRS . 2.24. 0.83 ,33 :,2.15 - 0.66 27, . -0.46 : \ n.s.' ■. . 

■■ Time taken to deliver materialsA ■ . , 

. fromEISO.' '■ ' Y 2.42 0.72 53 . 2.48 ^^ 33 . • 0.39, ; . ■ > :n.s^^^^ 



^Utij of leckologij ■ ' ,/ 

Length of bihliogr^hy -, 2.41 0.66 227 .2.43 0.63 ' 110 ,0.26, ; 

.. Iteadability-ofmcrofich&copies ,^2.33 0.70^. 2.29 .0.61 '62 • -0.37' ^n.s. 

; Availability o£.mcrofide readers; 2.56 0.60 57;,: ■ ' -O.B , : 

,.7alT£ofBihliogTOJ^}i:!j(MM()^eM 

■ ■ • Bibliography ; ' "2.19 ; 0.69 221 2.21 72 ; 110^ ^^T^^^^^^^ - is.' 

■ ' Materials' located via ba^^^ 2.25 vO.68 ' 134: ■ 2.18, -0.79 ■ 90 ' V-0.71 \ ls.,, ^ 

' ' .fa-- ■ I ^ 

. ■' . fSeparate- questions conc^im^ convenience, of .arrangements and adequacy of directions for submtting seardiiequests 
\'' weie asked ill Year l,lil^^ . , / ■ ■ ■ ' .-i; . 



■' ■^itein on: time devoted to search interview did not ^ax on Year 2 questionnaire; 



eadilbdted a st,atistically -significant difference. The change observed fe>r 
that item, which concerns the helpfulness of the search analyst, is not oil . 
concezn ^ince, even taking the decline of .11 mits into accoimt , . the .. 
average response indicates an exceedingly high level of satisfaction.. 
Indeed, in both years the helpfulness of the search analyst was the most 
highly rated characteristic of the service, a fact vfliich spealcs well of 
' the prof essionals enployed in this position. 

Mcmthly^Tjrends ; . ^ 

In addition to the anniial breakdown o£ data, further analysis o£ data by 
months is needed to discover any effects due to the month to month vaidLa- 
tion in the volume of EISO's business or to significant changes vfliich 
have taken place in the system. , Two changes warrant special mention, one 
of a technological nature and r the other concerned with changes in person- 
nel. • . ■ ■ ■ ' ' 

The major technological change that has. occurr^ed during EISO's two 
years is the development of irb're pbwerful can5)uter programs for searching - 
bibliographic data bases.. Most • important of these' improvements is 'the ^ 
ability of the ccnnputer to search the text of abstracts *and titles in order 
tp locate strings of words.' For exaifple, a. phrase like ''Early School 
leaving" might be used to-lpcate articles on that topic' In this , way, 
articles and documents can be located before the appropriate term enters 
the indexer's vocabulary. This type of string search, capability is avail ' 
able now on loc^eed Infoiinati^ System's DIALOG retrieval system but not 
on System Development Corporation' s ORBIT. The fact that DIALOG offers 

- the ability to search strings of words, combined with the, large ninnber of . 
social science data bases which are aWilable^frbm LlS.but not from SDC, 
has influenced EISO's, search analyst to do an increasing nimiber of searches 
on Lockheed's DIALOG. This trend began slowly in late 1976, but acceler- 
ated in 1977 after Lockheed reduced its prices. Now, inost of EISO's ' 
searches are carried out_xm Lockheed's system whereas at the start •'of the 
project SDC was used almost exclusively. The iiipact of this change on 
laser satisfaction, is; a question that we shall address later, but ^t xs a 
factor that could be reflected in month to month changes in levels of 

.user satisfaction*^ - 

' The major personnel change affecting EI SO' s operations was the re- 
placement of its first" seai^ch analyst, vAio resigned at ^the end of April, 
1976.- Ifiilike the first search analyst, the new analyst came to EISO with 

mam 



no -experience m ijeing ccsnputerized bibliographic search, service, though 
she did have an excellent background in the humilities, social sciences, 
and education librarianship . As a result, she was trained in conputerized 
. searching on-the-job under the tutelage o£ the fir^t' search analyst, and 
at training sessions offered by LIS and SDC. In spite of thes^ training 
opportunities, it was expected that there would be a period during whicih 
user satisfection might suffer because of the ••inexperience of. the new*. - 
; search analyst^ and* that the monthly trend in levels of satisfaction would ' 
reflect this inroact. , - . ' - . - 

^ Figure 3 displays the month to month average level of satisfaction" 
reported by users for four of .the six ^scales used to assess EISO's- 
effectiveness. Included are Quality of Service, Quality of Technology, • 
Value of Bibliography, and Overall Satisfaction- Hie remaining 
two scales, measuring satisfaction with Publicity Materials and DirectdGn^" 
and Timeliness of Serxdce are omitted because .the first was not affected 
by any system .changes , and the second had too few responses to provide 
sufficiently precise . estimates of montiiiy averages. 

Overall Satisfaction has been remarkably steady for the' entire period 
of the service, always^ranging from between 2.4 and 2.7 on the three-point 
scale being employed. During l±ie tenure of the first search, analyst, the - 
monthly average remained within if - 0,1 units of 2.6. In contras't', <irring 
the period from May 1976 to September 1976, while :the' new search 'analyst 
was gaining experience^ Overall "Satisfaction changed considerably, rising 
' from a ^low of ^ . 4 .to . a ' high of ' 2 . 7 . This is the type of ..-trend line that 
.'had been expected. However, there was a significant decline" in average 
satisfaction in October, a month in, xdiich use of the service peaked vrith 
■55. search requests, ./toparently, it was not possible for ElSO to inaintain 
-a consistently high level of performance \dien demand escalated beyond a 
certain point. 

The three conponents of Overall Satisfaction exhibited some- 
•what diffei^J!^3trends: .. Quality of Service remained at 2.8 ± 0.1 during . " 
the fi^slTyear, and 2. 7 ± 0.1 during the second year, except for ^ May, the* 
new^^arch analyst's first month. However, in interpreting thi^ trend, 
the size of samples on i^Siich the estimates of averages are based shoiSld 
be borae in mind. Only four EISO^ User EvaXziat ion Questionnaires were 
returned for searches con^leted in May. Such a low number provides a 
very- in^^recise estimalte of the mean. ; In fact, estimates of all sfe^OTid 
year n^ans/are based on fewer responses' than are monthly estimates for 
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' FIGURE 3 " AVERAGE USER SATISFACTION M 
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the first year, thereby making the second year estimates of means intrin-^ 
sically less ^precise and^more variable than those for the first year. As 
a result, second year ••trends!.^re\^more jagged. 

Quality of Technology, pother coiiiponent of oyerall satisfaction, is 
^ext^emely variable throughout the two years. Its range is e^xemely vride: 
/•2. 4 t Q^4* On the whole, it must be concluded that no discernible - trend 
has occurred, and that neither the seiarch analyst nor search system has 
influenced this factor. . 

The Value rof Biblio^^hy and. Materials- also fails to exhibit any 
trend. Its range 'is 2.2 f 0.4, though the very low level in May can be 
discounted both due to' the small sample size and the .fact that it xvas the 
search analyst's first month. 

The ranges indicated for the scales above provide baseline data for 
setting standards for perfoimance (Table 30) . ' A periodic assessment of a 
search service could be carried out using the six scales employed in this 
study as standards to judge, the acceptability of. the service's performance. 
' ' ■ . * ' ^- ^ . 

TABLE 30" r- INITIAL ESTIMATE OF ACCEPTABLE LIMITS OF PERFORMANCE 

. AS MEASURED BY USER SATISFACTION \ ' 
-i-l ■ ; , \y- 

' . . ^- ^ ■ Annual I4onthly Monthly 

Variable • ^ Average Minimum Maximum Ranges 

- ■/ . 

>■* . - ■ ■ 

Sadtes . . ^ 



Overall Satisfaction 


2 


.55 


2.4 


2 


.7 


0.3 


Quality z'~ Service ^ 


2. 


.75 - 


.2.6 


2 


.9 


0.3 


QualilT'" r f lechnolog)?' 


2, 


.40 


. 2.0 


2 


.8 ■ 


0.8 


Value of Bibliography and Materials. 


2. 


.20 ■ 


- 1.8 


2 


.6 


0.8 


terns 














Helpfulness of search analyst 


2, 


,75 • 


2.6 • 


2 


.9 


0.3 


Convenience of obtaining search 


2. 


75. 


2.'6 


- 2, 


.9 


0.3 


Time taken to deliver bibliography 


2. 


e'o 


2.. 4 . 


2. 


.8 


0.4 


Length of bibliography 


2. 


4'0 


2.2 


2. 


..6 


G.4 


Value of bibliography itself ^ 


2. 


20 . 


1.9 


2. 


.5 


a.6 


Materials located via bibliography - 


.2. 


20 


1.9 


2. 


,5 


0-6 



Corrective action coul4 then be taken if thei. bounds are exceeded. There 
is cue. scale for which staJidards set in tliis way may be too low;' namely 
measuring the quality of bi^^liographies and materials. An .understanding j 
iDf the factors affecting tJiis variable must^be achieved in order to deter- 
mine if it. is possible to raise its ievel.. A first step in this is analy- 
"zing- the trends, of individi^l scale items." . 

Figure 4 displays tr^^^cJs in .monthly ayerages for 'six items that re- 
. late directly to the tiser^s satisfaction with performance X)f the EISO -**^- 
search service: .helpfulness of^ search analyst,- convenience of obtaining^ 
search, time- taken to delivet-. bibliography;^ length of bibliography, value 
of bibliography itself,- ancJ ^naterials located via bibliography. .1 The tren^ 
reveal that satisfaction wi'thr EISO* s search analyst is very s table , except 
for a drop in May 1976, as is satisfaction with the conveni^ce 4f request r 
ijig an EISO literature seafch; Satisfaction with the amount of -^ime talcen 
' _ to deliver the bibliography > however, has hot fully recovered from a drc^ 
^ in Ma)t>- . This drop may in be accoiini;ed for ,by the' delays iirpos^ by 

^ the Use of the Lockheed system 3, Which' does not'* allow lite search analyst to 
; request that bibliographies sent. 'dire^ctly to the clients. Also; EISO ■ 
.-has .experienced backlogs during busy periods like. October. It Would ♦ 
^)pear from first-year data tha-t average satisfaction levels for. delivery 
times can and should b^ maintained in -the -'2 -6 ± ^.2 range, .and that this 
has not been consistently achieved in the- latter half of 1976. If follow-: 
vp questionnaires now being returned from noji- respondents, confiim this 
fact, then this area will w^^ant further investigation and action. 

Satisfaction. with the lenjgth of bibliographies has been consistently 
in the 2.4 ± 0.2 range > exc^t for October when the service experienced 
exceedingly high 'deman^i- that" time, a decision was taken to counter- 
the reduced time available for planning search strategies by providing"^ 
longer bibliographies. Tha'*^ is, rather than placing additional conditions 
on the search strategy in-^^ord^ to increase precision and decrease the 
number of citations, search^^ were conducted at a more general level. As 
a result, the average number of citations climbed from 82 in August and 
September to 134 in October- Clients -had to cull through more citations 
in<<>rder to locate relevant doctmients, and it appears that this task was . 
sufficiently difficult 2nd t^iine consuming to reduce their satisfaction . . 
with the length of bibliographies. Assuming this analysis^-is correct,, 
then it Would appear , tl^at tl^e client's satisfaction with "the ^length of a ^ 
bibliograph>^ is..-^factoX th^^ i5. sensitive to changes in EISO ^s practices, 
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; that the average leng^ o£ bib iiog3^ o£ 

/75-^ -with, a inaxiim^ otherwiise ' requested^^^ , 

: \ ■ •■ • -the client..^,. , \ ' . r - ' ^ -* ;■ . 

■ - . - • Satisfaction with "the value of . -die bibliography itself 'varied con- 
siderably f r o m iipnth. to month; rising as, high as 2.6 and falling -as low> 
as 1^4* In general, it- fell icithin the range of 2.20 ± 0.S, and it ' ' ; 
appears that this is a range that coizld'be considered as being acc^t^le;^ 
if it is considered as an initial standard- for performance. I^^^i^'notable 
that, even -in October , during the period when bibliographies . terii:^.. tc5^e - 
' too long, satisfaction with the bibliography itself -reraaiiied withln^^^^ 
range. At the same time, 'the high satisfaction level achieved. in two^.^^ 
inpnths, September 1975 and August 1576, show that high i levels of satisfac- 
tion can be achieved. Wit±. further investigation, ^^^^^^^^ 
\.: locate, factors idiich provide iis tlie leverage needed to obtain consistently 

' ■ ' high results. In -the meantime, the aforementioned standard will = h^^ 
. suffice. ; . \ 

Assessment of satisfaction with the materials lockted \ria -the biblio 
V graphy. suggest that it, tod, varies considerably i^om month ta month,. . 
and\ tends to vary with the perceived value of the bibliography. The range 
observed is 2.2 ± 0.3, excluiiing May, and this range can be -used as ^pJ v - 
. initial standard. ^ . ' : 

A summary of initial standards for ^ the six saitisfactdon items is? , 
given, in Table^30. ft should be eir^^hasized that the standards are derived 
' ♦ \from actual results to date. Hence,* they are V^ealisti^ standa!rds; - it 
'^^ ^f' should be possible to maintaipL thejn. . However, they do not necessarily > ^ 
^ ' represent the highest;- standards 'that it is possible to achieve • :: Addi-'j j 
; . > tiqna to determine .^at those ^ > v : 

^; . /r^ The monthly data trends, analyzed on a point by point* basis in- the- . 

' r ^preceding section, can also be analyzed in terms., of .annual cycles. a - 
.ailV data from two years, are available for four months i^'^^\ J^ - ' 

September,- and October. Ignoring effects that are due to ;syst%m .an^ 
personnel cdiaJiges, we can ask whether or not there, are c^cS^- changes. 
Talcing this perspective, one feature is notable- . In both^.y^ Septem--- 
ber was a month during- which clients were highly satisdK.ed with the value 
- , of the bibliography and materials, Vhile October's clients were relatively 
C - . ' less satisfied. As losage statistics indicate (Table 47), in both years 
Septeinber* was a relatively light month, while October was very busy., 
/.Hencey 'the volijme of rgquests may .in fact explaxn what xs apparently a 
ERIC <yclxc phenomena. - - 

/•""^ : 49 : - • . • ■ ■ •;O0Cfi^/.:^ ■ 



Si:QiiDary 



Analysis o£. user. satis^acticJn data coyeriii|g^two/years^ reyeals : that a con- 
s^sterrtly high level q£; seirAc^ ±s^ being provided b^^EISO.- Satisfaction 



partial the hiiman elements o£ the system the help- 

fulness of ^t^ analyst, - convenience of the service,, and quicl^ 

deliyexy of matyialg, ^Clieitts express positive, thoii^ ihodaj^te,' levels 
of satisfaction ^i&xit the bibliographies aad materials themselA^, Analysis 
of trend data suggests, t^ hlgjp^ levels of danandrin. peak months iesults^ 
a moderate decline in the quality of the servi.ee. Two ch^ges in the EISO ( 
service dependence on a different retrieval system ,and ^^Icyment of a ^ ^ 
new "seardh analyst may also account for changes in satisfaction leveis. 
Prelimnary analysis suggests that the effects due .to/ use of L^cldieed iather 
than SIX] are negligible and that effects attributable to differences in . 
search .analysts are small. Though both search analysts provided a level 
of service IJiat satisfied clients, tiie leaining cmiye of the new; s0aixJi 
analyst vras revealed in a stea.dy increase in perceived quality of biblio- - 
graj^pj^ retrieved during her first five months in position. ^ ^ / 

- Social Gorreiates of User Satisfaction - \ ^ " . ' 

Several factorsVhWe. been mentioned -which might explain differences '^ih t^ 
levels, of satisfaction .expressed by different individuals ^^t^ . 
EISO..- ' For- epcaii5)le, changes in the sei^/ice-*^s personnel and 
^t. the^^'ti^-a" searctf is requested may be. relevant factors. This sectiaft. 
aiialyzes- the .:^^ a number of other fa.ctors vdth client satis- 

fact-^Hi includirig the^^^^i^ and role, and the ; / 

type of system used. /^As . wel^^^^ two inportarit intervening variables . ^te - _^ 
identified: the percentage of ci^ in the b&liography that 4re new; 

•to the user, and the nunThpi: of articles or documents; d^om the bibliogt^hy 
that the User actually reads. : 



Location : 

lEt^was to be e3q>ected that tiie' geographical location of clients would be" 
a factor explaining their degree of satisfacticn/with those aspects of 
the EISO service that were related to their distance from Tordnto, such 
ss the time taken to deliver bibliographies and ^materials . Logically, . 
one 'would' think that those in Metro Toronto would be most satisfied. 




others in SoutJieiri Ontario- satisfied ^^^^.thSs^e in Nofthern 
..Qntaii^o^^ast satis £i ^ysteni jised>7as also felt to be- infliiential 

rsiiice pi^system used (SDG) allows biblio^aphies to be sent directly to 
the liseir, while t^ other, (LIS)- does ribt.- '-"^ ' ... ^ 

^ ♦ Table 31, displaying the users ' . average le^;%3f of satisfaction wil3i > 
taine t^en to -^live^^:^^ down by locaticm, system, ^ 

andy^r, indicates that loaatidn is an iinportant fa.ctor as far as' Northern 
Ontario^ lise^^^re ccmcer^^ They are' less satisfied, on the whole, tl^-on 




" ' ;FAC!ridf' WITH time to^deljver bibliography by 

location/ SYSTm,. AIW YEAR ■ * ^ 



System 



■ Location 



SDC Lockheed 



V. • K ■ ' s . n X ' s n 



r - 



Uetr'opo'bi-ian Tommto - 

Yea^-1^ 83 . 2.67". 0.53^ 

• Year.2, \ - - : - 2: 32. ■ 0. 39' 17 . ■ - ; 2^40 ! \^/0/72 \- -43 
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Southezm Ontctpio ' 



Year.-l ' 2.76^' 0.60 ' 60*" V 2.73 • ' 0.47' .■ 11 

Year 2 , . 2.83 d.39 12 2.59 0^7 , ■ .27 

NoptJiexm Ontario . ' : , ' " • 

Year 1 .">' 2-50". 0.72 . 27 2.33 0.58 . 3 ; 

Year 2 ". ' 3:00 ' .0 ; I. ' ■ -2.40 ' 0.63 .14 " 

those in either Metro Toronto or the rest of Southern Ontario. The latter 
two groiips are equally satisfied,^ and highly satisfied. *The retrieva.1 
'system used does not appear to be an rnrportant factor in tlie first year, ^ 
though some differences, are ^suggested in second-year da:t a. However, in 
the latter cas'es^;th^ variable may be masking the effect's of dif- 

ferent search analysts, since mpst $1X3 searches were conducted earlier : 
gj^^ie second' year, before the fii^t search analyst -resigned. 



The satisd^ction o£ clients with the time' ^feakeri t& dieliver materials 



«^ from EISO.m Toronto and ERIC Document Ifepro^ction Services- (EDRS3 in the 
Ifeited States -are Gontrasted in Table* .. - . 



-2 ■ ■ r 



TABLE- 32 — SATISFACTION WITH TIME TO DELTVER EI SO AND EDRS. 



-V 



MATERIAL^ BY . LOCATION AND YEAR 



Duplicati-on Service. 



Location ~ t^to^ ^ • ^ 



EISO ^ ■ . . - EDRS 









S ; 






-S ' 


•'ri.:--- ~ ■ 




. 1 -■ 















\ )-^:^esLr.^''^' ■ :^:2.A^ . 0.-73;, - ' 23 ; 2.00 0.193 ; 15 



Year 2 ' ' ' '•^2^79'.^^. .0^ U - ' 2.21 -0.70 \ 14 



: . ' ■ ;Year^: . : / r--r 2.^, / ■ 0^^ : ^ ■ -2.64.,-:- . 0.67 • 

■ .; i \Year: 2 ' > • ^ T :^.42.-.X~ r 0. 67 ' 12 v ;,- -^' I.86;- v - o. 69 ';7" . 

. Yearl * ' 2.,33 '^ '0^50 9 \ .. 2. 00: - 

/ Year2 ' 2.00 . 0. 82 /7 2. 33 0. 52 ; 6 ; : : 

— . ' ■ ■ - ' '. ^ • 7. . . • ^' 

<^ EISO provides better service than EDRS in Metro Toronto 

and Southern Ontario, while, the two are perceived to^be eqiially satisfac- 
tory in Northemt Ontario* EISO's service in Metro Toronto has apparently 
• in^JTOved in the past'year, and ;remained consistent elsewhere- r - 

In. summary, it appears that there is a n^^-to ijiprove timeliness .o£ 
service to Northern Ontarxb- >Bi the sh9rt jruh, this m^ans that EISO must " 
make greater efforts ; in the long rSa it^may mean that Northern Qtitario . 
needs a search se^azice of its own.; ' > . . / 

Organization . ' V : ; i '^^ vX^', "^^'^ ' 

Are users in. some orgahizatioais. more satisfied 
"o 'hers? If so, what are the explanations, and iiiplications. of such-a ... " y 
To answer these questions ,^ daJ:a. f^ 



•■/• 




Lyzed according to the organizations in which users were ' engjlq/ecf. The^ ' 
analysis vrais carried in two stages. First, "statistical " tests were. . ■-■• 
: carried out to determine., if ^signifjfe differences exis.ted' between the V 
. average level. of satisfactian on, each of the six satisfaction, scales' for 
users groiiped according to. the type of 'organization in. v^iidi they worlc^d- . * 
(Table 33) . ' This analysis indicated that signi f icant differences existed . 
on only- one scale : -VC^li^ second stagp of the analysis- 



TABLE "33 -- ANALYSIS." OF VARlMCE TESTS OF SIGNIFiECANCE FOR 
SATISFACTION^OF FIRST- YEAR USERS ^KEN POWN BY bRGANIZATION"-' 



Scale 



d-f.,. 



d.f. 




w 



/ 



F-ratio 




. Public j^ty^^ and 
- . Directions 

Qualily of Servdce'- 

Timeliness of Servieie^ ;> 

Qu^tlity of Technqiogy ^ 

Valu^ rof ^Bibliography; "and 
^'---terials . v . * 




ferall Satis faction 







■ ^ 0.26'2 




■ 195 V 


- ■2.144 


[3'. - : , 




.1.573 


3. ■ ■ ' 




_ 1.487' 


3 


: 129 ' - 


. '- .1-15^ 


3 


175 . 


1.350' 



o.ass - 

Q.P95+ 

0.225 

0.^2$ 

0 .328 
0.259- 




icant at the .10 level. 



, . consisted of testing pairrwise contrasts in order to determine between- 
what types of organizations significant differences 'in levels of satis- 
faction occurred (Table 34). By this ■ method-rt^E was determined that OISE 
users are, . on tlie whole, i^iore satisfied with- the " quality of service than 
those from school boards though it should be "noted that both groij^^s were 
^ highly satisfied. In all probabiSlity,. the ccjhvenience to OISE users of 
- haying the service .in-house accounts for this finding. -" " 

, - - The answers derived from first-year-; data have not yet been- tested 

. -with second-year data. However, an/initial analysis of - 
Overall Satisfaction^ is aiven in. Table '35. ; Though-. the ^ r^ _ 
.■^ .nqt statistical-ly /si-gni-'H pefhtaps in part due. to • the -large nijmber^ - 

'ofj groins; .lised an^-isihall size of Jthe sample, it is 'again' observed that.. 
-g|^(^tis'faction of OISE users is M^:i£rr .than 'th users. 



TABLE 34 



— AVERAGE SATiSFACriON OF FIRST-YEAR USERS WITH (JJALITY^; 
. .OF SERVICE BROKEN Daw BY ORGANIZATION 



Organi zat ion 



Statistics 



X 



s 



School Boards 
Postsecondary Institutions 

oisE:-' ■ ' '\ 

other ' . 



2.74 

2.88 

-.2.81 



0.68 

' 0,.:67 

■ 0. 46 



1 



•0.74 



76 
17 

56 
20 



Test for Significance F^. -oc-'= 2.144 p-value .= .095 \ . 



V 



Test for s ignif icance o f Gpntras ts : . . 



p- value 
/.v014 



TABLE 35 AVERAGE OVERALL SATISEACTION OF SECOND- YEAR USERS^^^l; _ 
GRDUPH) BY ORGANIZATION WITH TVHICH THEY ARE PRIMARILY ASSOGIATBD , 



Organizatioi;! 



Statisliics 



X 



s ■ 



n 



Public Board . . 
Separate Board . 
Postsecondary . 
Ministry of Education 
OISE 

1 Academic 

Research and Field 
. Development " : > 

• 'Library 



2.54 
2.43. 

2152 
2-60. 



2.,58- 




0.31 
0.45 
0.36 
0.67 

_oJ41 



0^ 



28 " 
7 . 

21. 
2 

25. 



0.25 ' ,:■ ' 9 



■ Other' ' ■ ■ ' ■■ , 


i 2.40 


0 •- 




£|^(-'fest for Significance 


.-^7,87;= Z^^: 




■■ ^.-s.- ... 









V. As.muduas anything, the., data for user satisfaction broken dcsvn by 
organizations suggest that an in^house system, has^, an edge over' an .external 
system' in providmg :good service.. This fact is: iji^jortant .in understanding , 
:the spreadihg\popularity of on-line retrieval services discussed^ in T3iapter: 

, We; can be sure that if an internal' service, provides superior service 
and an equal quality of bibliographies- to an external search service, -then 
the xiser's preference will be for the internal Sinc^ -most of ' . ^ ; 

•EISO^s Users are "external to DISE, - this, factor must be -borne in^'mirid \^^len . 
plamung EISQIsJfutm^. ,' ■ ■ . ■ . ■ . . . .■ V ' 



.. -Roles-:: ;■ .r. ■- :^ ■ ' ' _ ■ _ - 

. Are users: ocojpying certain roles more satisfied, with.: EISO than those in ' 
other 'roles? If so, what accounts for these differences? In answering , 
fhese two questions about - the relationship between the ciient^s role and .: 

- levol bf . satisfaction, ^ firs ;satis faction data were analyzed midi in 

- the -sajhe vray 1±at -had- bee^^^^^ for investigating the relationship between 

'organization 'mid satisfactipn.^ .fable 56 presents statistical; tests for the 

yyarioiis dimensions of satis'factioh broken do™ by role. • Significant dif- ^ 
ferences in satisfaction, among users in. :differfent roles wei:e: found :for two 

^scales : Publicity ^laterial^ and birectiGns.^ .and' Qt^ of .Technology. ; 

TABLE 36 -- ANALYSIS OF VARIANCE TESTS, OF. SIGNIFICANCE " • ' l^' ■ * 

SATISFACIION OF FIRST- YEAR USERS BROKEN mVN BY PRIMARY ROLE 



''■/:...■;■; . ■ Scale y". ■ / 




d,fv 

w 

— W 


F- 


ratio 


:F-prob. 


^ . Publicity Materials and^ 










■ ■' ■ 
— - ^ *' 


" f Directions . ^ 


. 4 ■ 


. 83 " 


2 


.562 


. ^ - 0-044'^ 


Quality o£ Service 


- . - ■ 4- 


.... 195 - 


;• 1 


.562 . • 


, ' 0.185 ■ 


: '^::%2mel±riess of Service ' / " 1. * : 


■- ', 4 ■ - ■ ■ ■ 


■ : -Zd^': 


■ '"■■0, 


.424; 




^ Quality o£ Technology 






: 2. 


1713;; 


■0.6^ 


< _^. Value of Bibliography arid . y- 
^ Materials- ^^'-^ :. ' . ' V -^ . ' 


** 












''•.128 ■ . 






.:. ;ov489 


Overall Satisfaction . - 


•■4 - 


175 


'i ■ 'G- 


■5^s. ■•■ 




a — — V- - " ' - 













\ 



Researchers aiid individiaals, involved -.in field development had tl^ 
most positive opinion about pi±>licity materials and directions; tJieir 
r assessment vras closely followed by those ;involved .in teadiioig, no doubt • 
many of whom were in postsecondary institutions. These grovips, on the . 
•vdiole, had .a significantly higgler level of satisfaction than did adminis- ^ 
trators and graduate students CTable 37). " One could infer' that researchei^ , 
field development. personnel, and teachers were more' knowledgeable abozit in-.' 
formation resources initially, and therefore found, the. material? easy t 



.■-:TABLE. 37 V- AVEEL^^GE SATISFACTION OF FIRST- YEA^ USERS'*WI'm" 
^cPlBLICIT^. mTEI^IALS. Al^^^^^^^ 



• ; PRIMARY -ROLE 



/ 



■■[.■ pr--:'- ■; • ■ • ■ : . 
■ y^y- Role . •■ - 'i 


St^itistics 
^ — , 




< • ' - . ■ . 


s ^ . • . 


n ^ 


.Administration - . . 1' 2.38 
Teaching ' ;* ' . 2.63 

Graduate Studies \; 2.41 ; 
Other , ^ • 2.78 


1.36 ■ • 

0. 65 

1. -ii 

. 0.-68 


' ' 20 
. ,19 

19 
9 


Test for significance = 2V562- p. 


-value. = .-044 . 




Tests for significance of 

1^22 - ^1 - "^2 -2.480 ' 
... V ^ t = -2.-075' 

• .^^r: = ,M^ - r . -1.889 


, . p-yalue ' .* 

:oi5 

; ^^041 
^ ^028 

V . /Xa62 ' ■ \ 


•> 

^1 - 









-ERIC ^- 



Understand. In contii^st, ijewcomers:-to . the field, many (?£ whm'were;ho 
doiibt. unfamiliar (^re^ ERIC, would have fburid the mter^als more dif- 
"ficult to mderstand an^, hence, less satisfactoiy/-. This ^finding suggests 
tha* a different approach may be needed for recruiting clients , especially 
..from: among administraj^rs in sch6ol boards . ^ Clearly, furthefyanalysis \ 
breaking down satisfaction by role. and organization' is needed. 

.Satisfaction with the qiia^ity of>EISO technology was highe'st among 
graduate- students and lowest among administrators (Table 38) . It may well 
be that the graduate students' direct access to the search service-,' all . ' 
ERIC microfiches and journals,^_ microfiche readers, etc.^help to explain 
the (^fference. 



TABLE 38 -- AVERAGE SATISFACTigN OF FIRST-YEAR_USHIS TVIIH 
. ''quality OF TECffiJOLOGY BROKEN OT^N BY PRIMARY RDLE -,;^ 



-■ . ■ V ;\^..RoIe- • , .,■ 




• . Statis.tii^. ■ 






■X- 






Administration • ' ^ - 


2.26 


0.58 


. - . as . 

» -{ 


Teaching - ' ' : . , 


2.48 


0.81 


Research and Field Development ^ .. 


J2_. 37^ 


0.84 


10 


.Gradijate Stiidies 


2-. 64 


. 0.74 


. 15 


Other . 


-2.00 

■ 


0' ■ - - . 


-4 


Test for significance " > ' F4 51 ~ 2". 713 . 


■ 


value' =' -. 040 

> 




Tests for significance of contrasts .■ 


: 7 






] ■■. ■ ■ .■ ■ . .' ■ ' ■ ■ ' . / ' ■ ' 




-\: p-value 






.459 







: Initiai analysis of second-year }data for Overall .'Satisfaction does " - 
not reveal ''any strikin^^ifferences.w^ broken .down -.by. either ^the users' 
priiiary role (Table -39); or .the-' role, in" the bibliography was reque^r 
ted (Jable 40). This suggests that.. there ^ds no; one g^ 



Q should be .addressed above and bevorid the others .. 

ERIC : • . ■ • ^ ■ •: 







■ 9. 













: TABLE . 39, AVERAGE OVERAIL .SATrSFACTION OF SECX3Nr)- YEAR USERS GROUPED" 

ACCORDING TO THEIR PRIMARY ROLES' ■ ' . ' ' 



Role 



Aiininistration an2 Smervision' 



' TesEcMng or Piipil Personnel 



Statistics 



X - 



2.50: 



2v56 



0^34 



0.37 



n 



36 



17 



Research 

Field Development- ^ ^--^ - ^ 

■ '" '.- •: - 1' ■ ' -.:<'": 

Library- - " . . . .' 



Master's Students 



Doctoral Students 



■2.66: 



2.57 



...2.80 




0.31 
0.29 

0.20 

- - }f. 
0.43^ 

a. 50 



11 



10 



other 



2.44'.- 



0i'3O 



Test" for signifa'cancei 



7,87 ' 



= . 77- - n.s. 




ERIC 



- V 








' ■ . ' ' \ ■ ■ ^ 




- TABLE 40 — AVERAGE OVERAIi SATISFACTBSM 


IF SECOND-^nEAR USERS GROUPEE) ' 


AC(X)RDING TO TfiE ROLE IN WHICH Ti^ 


Y REQUESTED SEARCH ' - ^ > •: 


, . - Role • ' -i 


. Statistics ^ 






■ . -?■ . . " . t -■. ■ . •> 



. Administration Sij^jervision 
. Teaching or Pt^jil Personnel 



2.53 



0.31 



19 



Research- 



Field DevelopiEfent 



2.57 



Library' 



■2.59 



2.47 



.2.87. 



0.32. 



0.21 



0.23 



33 

6 

•■ / 
3 



Master Students . 



Doctoral StiJdents 



2.-53"--^ 



2 .54: 



2.^2 



0.40 .■ 



0.48 



10 



17 



OtHer 



2.46 . 



0.36.' \ 



Test fo^ Significance 



:6,^8 



,62 n-s. 

. - ■< 



"0 
ERIC 



Stmnnaiy . . ^ jgt ■- ' > 

■ . ■♦■ . . » .* • ■ 2. . ' 

... » - • ■ . 

The ease of access that clx^ts. Joave to EI SCi appears to be an iii^portant ♦ 
factor iii explaining their .differences in levels of satisfaction* Those 
vtfio are close to the service, ^specially those holding positions, in the 
OISE buirding, tend to mor^ sa-tisfied with the' service -than those 'in 

; distant locations; Also, tho^e who hold positions in \^ich adniihistra- 
tive rather than academic^con^^irtis are b£ iji5)ortance tenid* to be soioevdiat ^ 
less satisfied with the time "taken to deliver bibliographies, the quality 
of publicity materials, and tl^^ qioality^ of 'the technology^used, , Yet, it 
should be einphasized^ that , ofi "Qie whole, users e^cpressed meJdium-lugJi to 

■high levels of satisfaction ^bour all aspects of EISO, regardless of their 
location, organization, or ;t'ol^, ^ ■ 

y . ■/ Intervening Variables .- 

User characteristics, lilce location, organization and role, and search serv- 
ice traits like the retrieval system "used and the identity of the search . . 
analyst,; are. all input variab^-Ss, and by -themselves cannot be expected to 
explain all^'thq.variatiort isn tis^r satisfaction. Process variables such as 
' the user's retrieval of docum^^ts ^d- acquisition of knowl^odge may be >o£ 
equal or greater iiriportance, .Qrie ^ould expect that the individual vflio 
undertakes the reyiew of a^l3.r|^ nuinber of articles and who learns- a great 
deal of new information will 'be jnore positively disposed to the search 
than' one who has^not. in the second year, two of these intervening process 
variables were measured: the ^^ount of material located via an ElSO' biblio 
graphy^tfiat the client actijal 17 r^^d, and the percentage of the material on 
. the bibliography, that was new Jxim. " Table 41 provides a -breakdown of 
user satisfactipri on all five si^bscales ^lus the. overall scale according 
to the number of documents or Journal articles that were read. - " 

For three of the sca-les, the differences' among means are Significant: 
iQii^it^of Service,. Value of'th^ Bibliograph)^and Materials, and Overall . 
Satisfaction. The- second of th^s^ is clearly the irtost .i^ 
,amang the five in terms -of u^er- satisfaction. . 
.material for no more . than fiv^ i^ef^rences expressed a medium- low- level . 
of", satis fact ion with the ^^ue- of the bibliography arid materials, while / ". * 
tihqse" reading oyer ■ ^ 



TABI£ 41 AVERAGE SATISFACTION- OF YEAR- TIVO' USERS '^ON SIX 'SCALES 
V • ., • • BROKEN raVN BY NUMBER OF REFERENCES . READ 



0-5 



Materials Read 



,6-10 11-20 ,21+ ' Sig. 



Publicity Materials 

' " ■ ; ■ ' ' ■ 

Quality; of Service 

Timeliness- o£ Service 

. Quality ' of\|dmology 1 . 

Value p£ Bibliography and, 
JMaterials . 

Overall Satisfaction 



2.61 
-2.33 
2.48 , 

1.85 

2:47 




■2.00 
-2.43 



2.-54 
'2.83 
'2.50^ 

2.59 




n.s.;' 
.10-- 
. n.s.- 
n.s.. 

• 05 . 
.-.05 ^ 



— ~ ~ ■ ./ . 

But is- reading, references enough?- Is it not equally (iii^ortant to 
question vSiether or not the material ^is new? ' Table 42 presents an answer 
to this\questiori, and suggests that there are other- influences on- 



TABLE 42 -- AVERAGE ^TJSFACTION-'OF.YEAR-TWO "US;^' SIX SCALES 
BROKENTilOVN BY -PERCENIAGE OF MAimiAL IHATiWAS NEW v " 



Scale 



Percentage of New Biform^ion 







10-20^ 


21-50% 


'50+% 


Sig. 


Publicity Materials . 


/ . 2."48 


2.53 


■ '<r?' 
2.41 . 


'2.67 


n:s. 


Quaf ity "of Service ^ 


2.75 . 


2.73,- 


" 2.71' ■" 


2!g2 


n.s. 


Timeliness' o£^ Service- 


.\ . ■ ■ 




-2.33 


... ✓ 




Quality o£^ Technology 




2.41 


' -2.43 .-' 


2.62 


I'n.s. . 


Value 01 Bibliography and 
\Ma^rxals ' ^ - 


V 1.13 


. ; l'.9l'. ; 


■2. 50 


2,53"' 


.05 


Ovei^ll Satisfaction^ 


2.14 


. 2.45- 7 


•2.57 


-2.76.. : 


' .05 



--^-r^ 



Ct5083 



< 



61 



"user satis fact icm. Those reporting no new information v/ere riot satisfied 
mtli the value of the materials, those finding 10 to 20^5 new were satis-. • 
fied?^ and those- finding oyer 20% new materials were highly 'satisfied. 
This last finding suggests that, it -is only necessary td.have one of every 
five references in a bibliography that are new and' relevant to tHe client 
in prder for him' to be highly satisfied. * .. . .. 

An 'a^diti6nal; factor that ndght be related to satisfact^ "th the. 
value of a bibliography is the data base searched. ' That is, -as. : 
determine. which of the major' data bases are best at satisf>^fe, c ^^ients 
infoi:7nation:needs.. Differences in levels of -satisfaction observed among 
Jjie Iters' of 'ERIG, Psychologi>oat Abstracts ^ and^Socn^aZ Sciences Citation 
Index- iSSCiy ^Bxe reported in Table 4^. • Again^, it is primarily on the 

TABLE 43' AVERAGE SATISFACTION OF YEAR- TWO USERS ON -SIX SCALES,; 
' ■ ; ' . BROto'IX}i?N BY DAT^ ' - "^/..^' V - - • ■ 



Scale 



Data Base '-Searched 






'Psyeho.Zog'icaZ 
AbstTacts 




Si-g. 


2.55 :• 


2.54 


^2.08. : 


— -4^ — ^ — ; 
_ n\.5.; V 


2.74- 


■ . 2-65 


2.63 : 


ft.s. 


. 2.3S 


- ..*^r. 






2. ■47' 

< 








2,30 
2^.60 


-VTv;."- . •■ 


." i -.67 . 

2-15^ 


*".10 - -. 



Publicity Materi-als 

Quali^^f Service 

Timeliness pf Sewice 

Quality of Tedinolog^ 

Value' of Bibliography and 
Materials 

Overall Satisifection 



Valije('<of Bibliography and.MatexTials tlWt significant differences^ .^^^ 
\ , obsetved. -.Clearly, ..se'ccjirid-year cjj^omers; have been more satisfied vdth' 

ERIC bibliographies than -Xhoser^ftjS^^^^^^ Abstracts and/ SSCI. ' . 

" -Either. .these two data bases-aj^^less^releiLsmt-^to clients^^^ 

are^not ^le to s^rch them effectively/ Certainly, fo^Fther investigation 
of tlie lovrS^vels V>f satisfaction reported *by iiser^^of Fst^holog-ical ■; . 



i4£^s7i:2?<?^c*5 and SSCI. are waixantea. 

ERiC^ 




\ ■ 



ft7 




Correlates o£ Intervening Variables 

Discovering correlates of the two intervening variables nimber. of docii 
ments read and percentage o£ references that are new to the user inigh- 
provide insight' m can increase the user's, satisfaction vdSh 

."value o£ the bibiiograph materials.. .There are at least tw6 techno- 
IpgiG^ variables that are possibilities : - the system used and the., data 
bise searched. As to the former, it has been noted elsewhere that the. 

. ability to string search on the Ix^ckheed: system had made it the system 
preferred by the search analysts. But is it really better? As for thfe 
second, we hav^-^eui^T^^^ ERIC is cimrently' the^ preferred data / 

base; we now wish to see i£ it is preferred becaiise^'it provicte biblio- - 
gravies witK jnoreL^cit^&^Ss^for iN^ch:- the users read ^f^^, original " \ 
materials. ' - - V: • 

The; system and data Bdse ^used are related to the' Number o£ References^. 
Read in Table 44'/vihere the. latter variable is placed on a four--point scale. 

* ■ • 1- * ■ ■ . - 

■ ' 4 : — ■= ■ ■ 

TABLE 44 .NUMBER OF REFERENCES READ BROKEN pOWN SYSTEM, • 
* ■ . ' ' * • ' AND DATA BASE^ . . ' ^ . ■ 



System 



r 



Data Base . • . . ^ Lockheed 



X s n - . s n 









- :ERie ; - 2.76* : 1.22"' 29.-. : 


2.22.'^. '1.12 : 


63 


■PsychoZdgiaaZ^Abstr'ctats — 


2.72 .1.01 . 


11 




2.25: 1^6 


4 




■^Average on four-point, scale: . 1 = 0-5; 2 = e-lO-y'^S =11-20; and 

4. =-21+. ■■- ••^r ; ■ ■ / . ■•■ ,v 

• The- averageTScale value -*£or .search b£ the .ERIC data base conducted ; on SDC 
is 2 i 76 , •wMch translates into ^^put^^^^ . articles or documents that were ' 
read ^ tHe user, /^f one be-Eween the mi^oints of the-interTs: : * 

vals. Searches of ERIC on Lockheed, however, apparently provided an >>. . 

-' average of oialy *niri^refeTences for**v5iich- th.6. cm^ and read ' _ 

drigin^-iinaterials; ; ■ . ' . , • 



. V ; Ideally, ^^^.t^^^ relative -effectiveness .ti}^ ^^ -aiid U>(^^^^ ^^^'^'^^ 
■,' .^sterns couid,be :ass^^ fo^« seard}^^ 

;. ■ .'iSicA vrere- cam out usin^ each of .t}^^ ^/^t^ms. . jj^vO^^g^^^ 
data from;Table'44, such a. conparis^^ 

/• the better ~sx5tem since it retrieved ino:t-e ^ef ^^^^^'^^ ^ "'^o rel^"^^ ^^^^nts 
• '^than did I^cHieedJs piAllc^^^^^ However; cons^'^^- concl^^^ ^P^r- : 

, ranted since we" i&ow^^ Xoddie^^ ^^^^c^es wel^ ^^'^^^^'^ 

^.-^ diffejenf-searcH ''analysts.- Further ajiaiysi^ ^^cperigieia^^^^^^^^l' ' 
•be nec^^^ary to control for the effects ^ue to ^^^^^^ent se^^"^ ^"^^^^ . 
. - if ' We are to ' jiidge the " two fairly. At the sai^^ the d^^^ '^^X.q ; 

^ , 44 does provide evidence, that DIALOG'S g^g^^gj-. 

. not giVe it an oyexwhelming edge ov«r ixi '^^^T^^Vi^^ ^e^^"^^ 

^^ents from ERIC. . This finding runs coi^t^ary Pinion ^ 

> the field of information science, some of whorn-^^-^^l^Ce toa ^^^^ ^ 
-^ emphasis on technical rather than hxjmaji ,facto^^' ' . ' 

Searches of Psy<^h:ologiG^ Ahstrctc^^ ^^^i sei^'^^^^'^^'^'^ 

iTidex vtere limited to' the Lockheed system sinC^ a^e not? 3^'^^^^^'^^ 

from SDC.. On the average, approximately ^g^erence^ ■psy^^'^oQi^al 
-| and nine f^^ - ^ ' " • ' 

More important than the number cff ^^.^;j^e5 documeii^ -"^^^ clients 
• : read^is whether or not ■ the matp-ial^^ new to^?' 

^ there.- Table 45 reveals that, WardlesV o£ th^ ^^^^ejn ployed' ijser - 
• 'who requested, an ERIG search wasH ike ly ^bout 5^^^' '^'^^ 

: references provide'd new information. Thg^g ^e^'^^^ ^Sain coii^^'^ " ; - 

th^re is probably little appreciable diff^^gj^ce^ ^^"'^Sei^ the ef^^^'^'^^^ess . 
- ■ of the SDC and Lockheed systems. - '\ ■ " \ 

. ' sirches of " ; ■. 

- -perc^tage of materials that were new ^^S^^ ^^r^ ^ tX^^. . , 

'searches of ERIC. For j>sychologi:cal ^hQp^^ts^ -^'^y 2o% of '^^^^^s 
" were new, on -the average, -and for^^5^^:r-^oniy l5'^- ' ^1 of -.^^ : 
' which were, rather few in niD*er, "i^'ere eoi^^^^iJig ^^^G si^^^ . 

.bases are not available from SDC- Lndeeji^ it ^^^^ ^^Pear tii^^ • 
. ' advantage that DIALOG offers- is nor its tedini^- ^^^^bilitie^ V its .. 
, V selection of cSata bases. •. ■ . . . ^. 

. : ■ '^ V • Several insightV-are provided byVtj^^: ^^^ analysis '^^.^ : . ; 

■■ ■ focused on .the relationship betiveen two t^c-hno^^f v^riabl®^ ' the ■ 
' system used.and the data base .searched, 1^^- ^^^^Vening variables, 

■ '^■ the number of docments or articles th^t^^;^^ ^^^^ >^ P^'^'p'^ijo ^ 



T^'LB, 45 pERCEm-AGE OF mTERlAL .THAT WAS- NB^ BROKEN JXm BY. , 



SYSTEM AND DATA BASE 



^ System 



Data Base 



SDC 



Lockheed 



■ \ 



n 



X • 



s • 



n 



ERIC 

ssci • : ' , ■ . , 



■x: — ~ — 
'v ■^'2.TS^ " 1.11 



3Cl 



2.79^ • 0:$8 63 
2.40 0.84- 10' 
2.00 . 0 • 4 




t^verage fnurrpoint scale: 1=0%; 2 = 10-20%; 3 = 21-50%; and ^ 

pi ^^^^ Vihich contained infonnation that was new to them. The latter 

^orrariables it recalled, were strongly related to the satisfac- 

X%o^ ^ers expres^^^'^^^^^ the yalue of the bibliography and inaterials. 

First*, it app^^^ that the system selected for a search is of little 
. jjcportande as^ 'far ^ clients are concerae^'. .SDC' s ORBIT aid .Lockheed's - 

pj^ALOG are 'equally effective . ji^rox^^ely one - th^j^d of the citations ' 
bibliogpapj^ies^o^e on either sy^^f^i provide the user with new infor- 

jjj^tion and, 33 ^ have seen earlier/ this is a sufficient percentage to 

j^eave ^the user reasonably satisfiec 

Second, wKil^ tJ^^^s report: tliat they found as many references on 

psy^^'^S^oaZ AbstrcLots and SSCT bibliographies for which the original/ . 
. jjj^terials were Vo^^^ -^^^^^^g on ERIC. bibiiogr^hies,, a cen- 

. gj^rabi^ smaller percentage of these materials provided them with new . .. 
. ^ij^ormatioii,, would^^pear that this relative lack of new information. ^ 

g^cou^fcs lower ievel of satisfacticm observed for searches of 



Conclusion . " ^ * ^ 

.£{jucatbrs .V)ho feve tried the'<5^ucational InfoTmation- System for Ontario 
(jtffi^g the past tVNTO years h^e- been quite' satisfied .^th the results. 
- ^ajre -p^j^jl^^-j^^ly pleased with the h^pfulness ,o£ the searth analyst 
FRVr?^^?^^^^^^®nience".of "the seMce, and .aris basically satisfied with **the 



timeliness of tJie' service and ^ t^ bibliographies and . 

- materials it provides. The qmlity o£ EISQ^s . services has been maintained 

\ ; in spite o£>the many, changes that" have occurred in the two years since EISO 
was started. Among the most ijrportant of these changes are the hiring.of . . 
^' a ne*ir. search analyst i5)on the- resignation o£. the first, 43ie \1tili2ation of 
- ' a different con^teri zed search, service from that originally xis^d,/ and1±e; :'v 
. searching of data bases that originally were not available. \Li addition, 
' new.piiblicily iraterials/. teaching materials, business forms 'and evalixation V ; 
' • have replaced the original versibns. " T ^ " ^ . . -'X 

, Da*^ collected' to datQ allow us to sugjjes-Vspjiie standards for user . ^ 
satisfaction that should, be maintained in the future. We expect that 
periodic assessments of the service will continue 4:0 be conducted in order 

/to ensure that the ^service *s high quality is maintained. Though the 

' • . • ^ .. ^ ■ . ■ " ' 

' initial values for these standarcJs, given in Table 30, axe but: approximate, 
\}ye.feel that the 'satisfaction scales are sufficiently^alid and.reliable * 

^■^'^forrthem to be used £or|^ assessing the effect of mah)/ changes in the 
service that may occur- or that might be undertaken in Order to improve 
its quality. As well, regular monitordjag of the service would provide 
feedback to the search analyst to indicated area^ that might be in need ' 
of iiiprpvCTient. / ' 

Analysis of data covering two years revealed at least one -factor , 
that may •lessen EISO's ability to maintain the quality of its service on 
a month to month ^asis.- It was observed that during peak months idien 
over 50 searches were completed, the q^lity of bibliographies apparently . - 
began to suffer.. In both 1975 and 197&> Qser satisfaction drppped in 
October^ v3ien -demand was highest. . 

* Satisfaction with the service varied according, to a nmber of social • 

- dEactors,_inclpdihg^13ler geog^ organization^and role of the 
EISO cli«it. Those from geographical locations remote from Toronfe were 
less satisfied the service m^^ and its timeliness in particu- 
lar, th^ -were' those from Southern Ontario and Metro . Toronto Those 
loc^ated in the OISE building itself ^re irost satisfied, largely because 
the service was so "convenient. Researchers and those active in field . • . 
development were inrore satisfied with EISO* s publicity material :^and direc- .. 
tions for losing the service than were either those -in school ^)dards or 

• graduate students. Apparently, knowledge about inforrnation resoinrces: in^ 
• general, arid ERIC in particular, is^ an important factor in e^cplaining 

^this relationship. \ , 

ERIC " ; ^. ; :t-^os8- 



^ Satisfection vath the bibliography, and materials ^^s positively, 
related to both the nisnber o£ citations for which users read "iJ^ origiii^l c 
Tnaterx^s the 'perceatage^::^^-~^??eW^^^^ nfew' in^ormajion^^ 

^ithqsi^ it ^Tys^':tJioiight;tiiat^^-^^ used, in conductiiigi^a seai^ca|^nd^^^ 

^■ixiijunt'^for finding, " this ."vi^ais not the g^^®' * ^ckhee'd' s. DIA^" and , ".^^ 
SDC's ORBIT proved equally e£f^=tive,, though the fornier does ha^ the - 
advantage of providing access to a wider sfel^^tion of (j^ta bas;ps. The. 
data base on which a search 'was run did prove" to be -inrpoj^tanj^^i 'explai^^ 
the relationship.- Searches--on aiid 55^7J ^ did npt^^ 

provide clients with as - large V percentage o£ ^^y . i^o:5jiiation as did. EjOiG^ 
searches. This I^c3c of new aiid relevant material resiiitedin a low levi^l 
of user satisfaction for searches done on these data bases?* 

- The findings outlined above, imply- that EISO should fo<Ss its efforts 
" on- majlntaining the quality of bibliographies that are run on ERIC, and . 
cpon^^ither increasing the quality of those run on other data bases or- 
being more selective in recommending searches on these data 'bases . At 
the same time; EISO should work to^iInprove the timeiiness of its service 
to those located in Northern Ontario. 

' Maintaining, and irnproving the quality of EISO's service is important, 
but is It equally inportant to learn if its .wprk is ccjntributing to the 
development of education in Ontario. - To assess its iinpact in ^ preljjninaiy 
' way,- several case studies , of the utilization of EISO niaterials were under- 
taken. These are the. subject of the ne^ chapter. 






In^sact o£ EISG on ^ ~?9^ool Board 



m^-M-'^-'::^^ - ^ ■:■ 

.1*) inattjsr how efficient and sqjhisticated a servic^^^^'* as ElSQSif l^t 
itself, its ultimate- inportance will be judged la^^^ ^ .terms ot the 
satisfaction of its users and the iinp^9^ it has an '^?^' Some of the 
s'iatisfaction. variables have already been analysed. Now it -.is time to 
^Ic at whether EISO. does in fact ef fect the conduct of education in 
^tJfe. s<*ools. Since it is virtually i^ossibie because of practical 
3.iniitations to study the long-term, indirect inpact of EIso on students, 

researchers^, cognizant of the irnp^^^CQ of this -issue nonetheless, 
-^cided to examine the more irnmedia'te\and indirect inp^ct of EISO on . 
tisers within one school board. To do this , they, interviewed 'the 
Director, 4 coordinator, a principals ^d a teacher all of whom were EISO ' 
•i;(5ers within a: single board .in the Northeastern Region, Ontario- . 

■ '. • :' . The Director . v ; 

-jhf^gion 3 school-board under consideration a rural _ one with a total 
- poinjlatiori -of about 5,000 students. ^S-'-ish is the another tongue of the/ ' 

maip^'^y* The Director is an^^erienced educator, an active. participant 
; in professional organizations, aj;d an innovative leacSer. Within the past ^ 
. eighteen ^months , he has used the EiSp service twice > Each taine-'^e' seardj ;■. 
^ . yfss initiated for his 'own professional use. yj^^ ^d. he. use- eiSO? What 
, > ■• .<iid be get fr^ What ini?act did; it have? ; 

•• ■--■■*.■■;. ■ ■ ■ ■ ; ■' . . ■, ■. 

'.ceardi Reqiaest-.#1 ' ' • ^ . '. • . ^ 

, ^ little over, a year- ago, his board formed a 'conmittee of -trustees, teachers, 
^ • aJid'TJaxents to prep_are a brief to be submitted to the ''Royal . Cranmission on - . 

. vioi®^^® in the Communications Industry. The committee' e3q)ressed the need: . 



for current- .iiterat'JT^ on the. topic and looked to their chief executive 
officer tQ^fi.J2^ need, ^eniemb'ered hearing about ^EISO at . an iatro- 
.ductc3,Ty,"m^^T|.^j;g ^eld '^1^^, preceding ^J™"®^ at. the Regidnal 'office pS^'t^e^ , 
, , - Miiiistiy. of Edu^^^ had siiiC^^°™^tted one his staff to.^ct as> 

■ an ,intermedia!rv bet^''^^ ^Qcal users and the mso.- se'rvice in Toronto. . He. ' 
. %lso;knev,r that he ^^^^^^^^^ f ree searches -available "^^^^ hijn and'ha^*even 



. set aside s"onie inoni®^ 'staff 'searchesV ' in. case, tfie free searches were 
. -exhausted, •theref'^^®' :^.®^ause. he ha^^^^^n involved in" ijmplement^g the ,.- 
• service -asi the .^i^gi^^ hoard from its Earliest Stages', ^ .was •. 

natural f dr. him '.to "^^^ "^o Eiso't'o acquire' literature on" a topic of 
-. concern to hinv, ■ ^^^iate motivation,, however, the reguest for 
"assistance f^^.j^is ^o^^^^'s committee. , 

^® submitted^ ^^tten^equest' to Eiso on the s^ciall^^^ 
:>^^ch rpq^^jg^.^^^ for, Region 3. users . XJg^ 

-^^^^ ^^^^ues^^/ 'the ^^^cih '^^lyst telephoned him to .acquire:--sdme "more ^spe^^^ 
information, she ^^^^^iiied that he was interested in work that had • 
appeared since 1970 on ''^he effect of television violence on students* 
attitudes Grades i /^^ough 6. ^ The analyst foTTTiulated a search strategy, 
:using the majo'r concepts of violence, television; . and student attitudes, 
and requested that a ^=^^iiog^phy with._38 citatiraisi^ printed off-line - ' 
• and s^t^to pirector. ■ ^canning the citations . and their abstracts, 

_ .„he ordered the origi^^^ ^^ticies,: had them duplic^ed, jand hahded liheni over 
^ jco -the c%ij^^ ^£ .the ^011^^^^^^^ ^^^Jao distributed them to the other commit- 
: '.tee members. ' • . - '. • 

board's consTiit tee pn TV violence 'did submit a well- documented 
. . brief to the Royal Comni°ssion. in addition to supplying the committee with 
•background iiifQ^tion, the Director. described* the.^ benefits] of the'seardh 
■this, ■way,:-- ; \ ... . ■ \\-:'-'-- \ ^ \- . >■■.■-■ ■']. :. .'■ 

^ ■ As -they 'soine> of. the documents that 1 was. able' to 
provide for theiQ^^ ^-oniniittee. cQuld' see thait some 
^ P^^ espouse the same beliefs that . '"^ . 

. ■ ■^^e're e5po^^g".here.- -The- board members and staff • - 
.' . . "tenibers- wh<> "^P^ked on^' that ^committee, were very ' satis- : . ■ ^ ' ^ • 
•.. • ^ied-xviththe..search. " ■ ' ^ ,■■ - • 

.. • The inip^^^ th® Second search was' equally significant, jierhaps 
more so, since it "^^^.^ ■'^^^l factor in the decision tq retain' the .Existing ; • 
. Kindergarten program" "'^^'^ system--" ' . ; . / . ' 



. Search Request ' ^\ ^ * . .. ■' -^^^^ 

^/^^^ a£ter submitting the: first searc^y.the Director was 

. ^- agaiiT^'ipp^ for- help by avtoard. comiittee- - -This time the trustees 

wer^ inte^^t!edi in con^iariTig the efficacy of ^e '^^xlszi^ Kindergarten 
program with altemati-ve . programs • . \ Th^ Director , therefore , submitted 
- V ^ a' reqiaest for j;i^EISO search on "the compa.raxive e|fects of ,theS7arioiaSr--T^ 
apprdaShes^to the' organization of a -Kiridetgarten? program, (a. e 
♦ half' day, modified full -day on student 'acMeveinent :' and also , on 

parental and ccramuni ty approval* ' v.. * . - " * « 

As before,- the search analyst spoke by i phone to the Director/ to 
elicit -precisely the, aspects of the topic in which he was most interested. 
She was able to formulate a searcdi strategy, combining appropriate combina- 
tions of descriptors such as . academic achievement , success factors , con- 
^ tinuous progress plan, and program evaluation with the central concqpt of ' 
Kindergarten to ensure the relevance of the bibliography, vfiiich contained 

- 49 citatiorts, was printed off-line "and sent to the Director- The requ^t ' 
was received, the tel^hone interview was conducted, and ^^^earch was ^ 
run. on. the same day* The bibliography was on the Director's desk nine 

; days later. Interestingly^ enough, one qf the citations was a study of 

... Kindergarten^ that the> Director and, his. staff hadT done several years 

earlier. - Unfortunately, howe^r,^ the mail- strikei.in progress at the time ^ 

prevented the Director from ordering any original materials. " 

The iii5)act 'of this search was siabtle but ijirportant. According to. 

the Director, it- had the following effect: . ^ 

The '.search ^gave confidence to the people who were lisring ' 
; - ^ I xt^ The fact that bur own material was listed as being 
. Si valid and useful document- [helped] us vrlth our:second 

* . Kindergarten .investigation . . ^ :* The fact that .there 
. had not/ been that much more reseaarci done in the four 
r. years. since\we:had'^ done .the last o that 

. things were not changing too much and that they were \ ^ . 

- - * up -to date: : * . ' ' ^ ' ^ ' ^ 

^ ■^ • . \ ■■ ■ ' ' ■ - i. *'/"';- ' 

. ; In addiction to whatever new ideas the search may have presTented them, 

it served to enhance the importance of the staff *s earlier reseiai-ch^^ it, 

.helped to confiim .the orig^al decision regarding Kindergartens- •Jiliat'had 

: ' been taken; it contributed to .upholding that program; an^^t helped 

legitimate the >Director^s position x^th his trustees ;.^since they decided 

to continue ^ si:5>porting a program he advocated. 




The Coordinator 

The coordinator "who ^is the subject o£ this-, report is one o£ four people 

ill his board' responsible for curriciilum development. The specific siibject V 

areas over which he exercises responsibility are mathematics, enviixmrnental 

. science, and music. A former elementaiy school principal,,: he.h^s held his - 

\ current position for two . years. ^ ; He differs, f rem the: other three users in- - 

I hUs board \Aio are* being described- ini..this Section of our report in that he 

/i^lone amongjthem also- fuff ills^^Iie role of an Educational Infdimiation Con- 

sialtant (Eicj vfof .-^^ In 'addition to being instrumental in . 

sl±Tiulating .use of" the bibliographic retriey^ system among the : staff .in,/ 

his boardj, however, 'Tie als9 placed one personal search that was directly 

-related' to his own professional, activities . It is his -rol^ as a' user', ' 

then, ^^thaJ: will be detailed here rather than his fi^ as an EIC, : 

thqugh it Is of course recognized that the impact .^f EISO on the school : ^ 

bosL^^ls ijitimately related "^b and indeed jn^ be inseparable f rom the 

par^^lJe played as an EIG.\ ' . - ^ • ■ 

^ ■ - . ' • I- . • * . . .■ ' ■■- . . ■ ' ■ . 

Search Request . 

When PUl first came out, the" supervisory staff and teachers at the school 
board held a series of meetings to determine priorities far- cuiriculm* //^ 
development in the system that woul4;lteet the objective the new 
Ministry guideline. Added to t3ie reqxairements of PlJl was the pressure 
exerted by parents, and teachers to come up with' a consistent mathematics" - 

Curriculum that would ensure -the compu^ skills of .the students ' ^ 

• ■ ■ ■ ■ _ ,■ ^ ■ _ - , ■ - ■ . ' 

qonpleting it. Finally, the coordinator, a math specialist himself, was 
-advocating :a problem-solving approach to mathematics teadhing in the ' 
elementary\grades.\- This' approach meant, as he explained it,. .7 ; 

' : \ ' ' . ^ ' ^ \ o -- . , - ' < , ■ V" ' ; - ' . 

' v>; viewing mathemati ^ 
' V the child could order abstract information into smie 

■ : kind -of a. frame that would allow him to make' order ^\ k ^ 

out of the cha^ic nature^ of the/.data prelsented to " 

^ •'. . •.him.. \ %-.:rS^- ' ■ V ••*■■'■-. 

With these "i^eds "in mind, then, .the coordinator mailed in a request * 
to l^e' analyst for the 100 mQ.s:l>-re^nt citations. on\ mathematics problem ^ 
-solving, conceptions , teaching- metho461cygy, and skill- Sequences . for Grades 
K-8. His di^rect reason for requasting the "search was to conpare current 
pro j ect ideas vdth the latest . literature ' f oi^pipssible ' modificat of the 
\board*s existing math^curriculumi- "^Upon receipt of-^Jie request, - the^ search 

erIc \_ . . - \ ; V " - : eops3 



.analyst-foimilated C^earch syndnyinous - terins. ^or — 

concepts that] she sugi the most loseful: elementaiy . 

' education, maftJienatics,; land teach^ techniques. She ran/it the next day 
^ • /lyithiji a.'jt}ee^ the coordinator received ' a - bibliography of. 48. imitations • ♦ 
' ^ . After carefi^L. scg|i^^ the abstracts, h^ placed, an. order ^ with - 
EISO for paper tropins of 16 journal articles and one ERIC document. on.,;v 
Itacrofich^. He also' ordered* oiie. listed ^disseiiiat ion ^ from Xerc^ ISiiversity ; 
Microfilms in Anil Arbor, Michig^ Although, after examining the . cdritent! of 
■ the original ' materials, he came . to thQ conclixsion .that only the dissertation 
■ ; Was directly, related to i^Saat he .was doing, he nevertheless rated his overall 

• . satisfaction 'vrith' the search as high. What th^ can we say resulted from " • 
. ,th3.^.'search? ^ ^ one thing, the coordinate gamed j5^e' satisfa^ti<^ 

^/r^ pride from the realization that he*; was breaking nev^[ground in. an 'area that. \ 

• ^ had. received very little 'attention the literature. On the othS^sJiand, ■ 

.the dissertation that he did •find provided ^just enougih confii^matioh that 
- Ms appitoaich was .valid to.; encourage him' to carry on. His perseverance, ' 
bolstered by his search^ is resulting i^jnain^ an innovative approach 

to teaching math^atics : in ' Grades K-8 in this ^system. 



■ ■ ; , r /^The Principal ' 

5- introduction of FIJI resulted iti a flurry of curriciilura development - v 

activity. \. In trying to organise' themselves to cope with, the iiew guide-; 
lines, the. teaching staff of the school board set priorities :Sor those 
curric^ar areas that they would deal with first. Some'^f the activity 

. ^ result^ in a reexamination of the m^hematics. program. Just as inportant* 
in the minds of both parents and teaoiers was ^the^ area ,of communications 
. or language arts . , lVhereas teache^^at the s^ondary leve]^lamented their 
^studehts^V inabil:^ty to write* effective 'English, teachers at the primary 
level were concerned ^^^ith the students^ lack of ability in th^. listening 

- / -skills area. TI«^ staffs of twinned junior piiblic schools were 'especially 



.interested tlmto^ something be done to improve the childrens' skills arid' 
' /they left the matter to their principal to come up with suggestions for a 
> - 'program that they could try out. ' - ^ . . 

* The pri2iS^ipal contacted the board's special education and lan^i^ge . 
consiiltants but they were unable to provide him with help in this area^ 
He ^tiien checked with nearby public and university libraries* and found that 
there was very little material available OT hi^ topic and::^tha^ vSiat existed 
was so limited in^scope that it gave him no basis from which to start. 
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^ Search Request ' / i . , - V 

;-J5j© 'da?^, the principal mentioned "his prbblem to th6' coordinator who sug- 
\. gested he- do an ElSO-search, The coordinator, an EIC on the EISO project, 
caine to^the principal '^s of fice^ the hex t day. They spent two hours dis- ./ 
cussing th6 problem, breaicing it down into its various cbngponerits, , and 
• . ^ difliosing -descriptors. Th^ .followingj3ay, the coordinator, in Toronto on 
business, stopped in to relay the 'request to "the search analyst/ She 
fpriimlated^' retrieved a bibliography .of 33 ci tac- 
tions on listening and cornprehension skills, in the primary grades. The 
bibliography was mailed to the coordinator. He delivered.it to the 
principal .^4io then ordered 12 microfiche 'documents and two journal articles 
, listed' on -it from EISO- These items he received within a week of" placing 
:liis ojrder. Although not all of the information was-^felevant to his situa- 
tion, the priiicipal described what he learned' from the materials "this way: 

Some things;. that- we found in the restearch^ikrticles ^ 
. . aad microfiches gave' us Tiope" or encouraged" us to 

keep- going. ?For example, a study done "in the Detroit . 
Public Schools showed that tii^ emphasis placed in tl\e 
classroom 'oni listening is abcrat 8 

re'ading. The same ^study showed that during the ave::^ 
working day of an adult, 9% of the time iis^-^volvec^ 
: ;>wfth ^^^riting, . abo and about 30% 

' '' talking, and 45% .listening. So with this kind of 

information, we felt^we cpuldn^t give up* If listening 
• occupied that^aiaoimF of "time, then \^ had to do some- • " 
: - thing, we just couldn^t let it gov . * . 

' ■ ■ \ ' ■ • c. . ' ' ^- ' ■ ■ ■ ; ^ . ' - ' ' . V - ■ . ' 

- The principal persevered for more than a year. He 5jif ormed h^s ^ - 

staff of his findings, assured them that the area of -iis'^ning was indeibcf 
an iii5>ortant though neglected^one,^ and gained^pfehe^r -CGiim^ so" that . : 

they devoted a series of professional development c^ys to develop mg.vdiat / 
Resulted in a listening curriculun for Grades^ 1-3. ' . - 

N&ich of the content. o;f that curriculum, the principal freely ^acknow- 
ledges, jderives from. the fiche^materidls he received^ EISO. l^iat 

. curriciilijni. is still 'being modify Itf is, _}^towever, an inte- ' 

;^ . gral part of the learning experience of 275 primaiy chilc3r^. 

' ',: . 'j.- ' • ^ . . ' ;:. ^ ■■ ; ' . " . , .V,^- ■ ■ , ■ ■ 

■■ - i ■■ The . Teacher -y ■ . ■ ' ■■ " • . 

• The d^AreXopment o£ new purricula was not restricted to the primaiy IcYel, 

however.' At. the large, modem high school of the board, a young but- 
^- ^cperienced teacher ha^ just received Ministry o£ EduCsation approval to 
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teaj^ a psychology: course that he had developed for Grade' 11 students. ■ 

His submission to the I^Iinist:^/ had-cofisisted of philosophical' and theoret- 

. • >■••• ■ , . ' ■ • ^ / .' • - ' 

ical rationale's for the course but had, not included the compilation of 
detailed units of - instruction to be in the classroom over the whole 

semester* With the actual implementation of the course close, at hand, 
such detailed curriculum planning became urgent. He described his ^pre- . 
dicameht -this way:' • V' 



problems were that I could write the course up using 
reference material from basically "college or university 
psychology tex^ boofe.x J'This was not the type of course . 
I wanteci to set up.. ' I wanted to set up a 'course which 
was jnore growth^ oriented , which wasn't a sort 'of siurvey 
of the literature. And yet, there wats no .written 
material which justified [this conceptuializatxon of] 
the coijrse to wHicih I could, go to find some confirmation 
that it was a worthwhile endeavour'. I had a good idea 
but 'every time I would go to a .textbook to look for 
materials or previoiis courses set up that-way^^I was' . 
always up against a blank wall. It was getting to the 
poiit where I was getting so .frustrated I thinking 
of not doing it. . - ' - . - 



Search Request ^ - ' 

At^a departmental " Staff meeting xn/^is school , the teacher mentioned his 
predicament to the local ccmsultant. i^o referred him to the coordinator, 
the ETC for the EISO project- The coordinator met with the teacher and- 
spent more- than an hour with him: defining his information needi. Because 
By now time was of the essence, he phoned in -the search to the analyst' 
the next morning. She was able. to retrieve 63 citations and nine days - 
later the teacher visited "OISE^ to examine some of 'the materials listed^ 
The search analyst discussed the' ipgraphy "With the teacheg^and of 
_her own initiative decided to run a second search- in *an effort .to supply 
the client with material that - would .be * useful -to ,^h^ This . second modi- 
" fied search, which retrieved 4^ ^c^ wg^^^ailed to the teacher w 



Ironically, the>mpst valuable items. 'appeared on &£:?t?2 bibliographies. 
The. teacher was-^bie to read.'2^ of the articles and microfiches while lie 
-was at OISE. ^ Of. t}iese./;,he fdmd'ti^ his first bibliography had nine 
/items, that were highly relevant and .reiad tly:dugl\ ^vp of" these ^ He^^ted 
' Ms -satisfaction with the value o5,the bibliography;^d the materials , as 
r.high:: > .• 



6,, 



/ 

\ 



0 
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It helped me justify fhfe fact that there ;are^ othe^r people 
*in.-.the-w^orld who are doing nvhat I was planning on dping, , ^ - 




and it gave me their plan of attack, bo-^ for the^ 
development and impiemerftation of the cdlirse. 



He went ,on to-siay that he was certain he woiald be orderijig^inore^ 



materi^s, from.EISO as he progressed toward v^^ing iip the final units 
of th^ coirrse- 




_Cpjiclusion 



It would be iri5)rudent td^k^ exaggerated claims for the impact of EISO 
in ^this board. Undoubtedly it could be said that the board would have 
subsnitted a brief to' the' Royal Coinmission ^>a^^ay, that the innovative but 
controversial Kindergarten and mathematics programs would have been 
' retained regardless, oxt^t the listening skills or psychology courses 
would "have proceeded vri. thout -EISO. We do know,- however, that- in the 
decision-maMng process there comes a time when alternatives must be 
considered, -and a final selection chosen. *ln the examples above ,^ EISO" 
bibliographies^ and materials clearly -contributed to the laiowledge base 
i5)on which rational decisioiB-were jiaken. Not only did EI'SO act as a 
source of new' information, it also provided alternatives, acted as an- 
encouragement to struggling but well-meaning educators, and provided 
concrete exainples of^how to- improve and implement J' curriculum programs. • 
We can, then, say with some" confidence that^ISO had a direct, short- 
range impact on this board and its staff. We can "only speculate abcjut 
the -ultimate iirapact of their decisions upon the children in the system, 
but we are reluctant to sijppose that decisions taken by less well- 
informed s-feff would have achieved better results . ' • 
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Economics o£ Operation » 
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In this time of economic stringency, the cost of operating, the Educational 
Information .System for Ontar^to is as important a factor as its effective-^ 
ifessJjjL filling the need thWr- educators' have fdr information. Responsible ' 
planning for EISO's future requires that realistic estimates of its full i 
cost and its cost per client served be avail^le in order. to make judge- ' 
ments concerning policy matters such as its future expansion and pricing 

system. , ' .-^ ' 

In the first Interim Repovi^ a theoretical model for the cost of an 
information service was presented that 'was based on the best infoimation 
then available. Included in the mociel; Was an . estimate of the cost of an ^ 

' average search. " At that time, a volike of 155 searches per month was 
considered a possible objective for a small search service composed of 

-one search analyst and one library assistant ^ and analysis indicated, that : 
■such a search service would . breaic even if a price of- $36 -was set for* each 
search. Two years of 'experience ha^now provided sufficient data for a" 
reassessment- of this theoretical model. From data that, have been collected,^ 
new estimates can be derived for parameters such as the number searches 
'per month and the amount of time required for each search. Substitution' 
of these for earlier,- more/ speciolative values yield model budgets vfliich 
form a better basis' for planning and developing- an educational infoimation ' 

--service. - . 

For the analysis that . follows., the budget of the Educational. Infor- 
mation System for Ontario is divided according to its two • principal acti^d- 
ties, a bibli-ographic search service, and an 'article and microfiche di5)li- 
cation service. The costs of each are analyzed according to fixed costs, * 
including overhead, ^d- variable costs. Models for search^ service 
are presented wjiich provide estimates of costs per year and per month^for 
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systems which operate at different levels o£ demand, v/hich ase flifferen't 
amouats of conputer time to cOnpljste searches ,^ andT- which provide' biblio- 
graphies of 'different lengths. An assessment is made, of the relative'^ . 
impact of these three parameters on tiie Economics , of the system's opera* 

J tion^ and of ^ the financial impact of^^mploying a t second search analyst. 

„JModel. budgets for .the' duplication service • at^^ also proyided^in .'order to _ 
'illustrate the impact of volijme of ordersz^oii- unit" prices . 

• ' Cost of Inputs ^ . , • i 

The costs of opet^ating EISO can be broken co\.n accordiiig to those incuixed^ 
for communication and data processing, staff , m^teriarls and su^jplies, 
capital, and -overhead. * In the sections that follow, the\cost of indi- 
vidual items alassified under each of these -categories are described for - 
both the search service and duplication 'service. Subsequently, detaile<|^;, 
analysis of the total cost for both seTvices are undertaken. 

Connrnmication and Data Processing 

^Lockheed Information. System's DIALOG and System Development Cpx^oration's 
jORBIT, the two main bibliographic search systems utilized by EISO, assess 

'Separate charges- for the time users, are coijnected to specific data s 

and telecominunications networks, and fo*'the number of citations that are 
priQted CT^bie 46).-. Rates for the systems diff^; e.g. , SDC charges $35 - 
per connejct-hour for ERIC, while LIS charges $25, and SDG's' charge^ for ' 
printed citations from ERIC xs $.08 each, while LIS's charge is $.10 each. 

^ Teletcimninications charges also differ, as ^do those for different data 
base^^^^ ^^^Ti system. ERIC 'is thp^ le^st . expensive data base available 
<3n boT^^systems , while other data bases of irit^est to educators cost /con- 
siderably more. For example, 'Psyal^otogtcat Abs^tTactSj l>Lss^r>tati.on\L, ^ 
Absl^izots ^ ' STLd SociaZ Sdeyices Citati^on Index (^SSCiy, all .available only 
from -^LIS, currently cost $*50, $55/ and $7p per hour respectively. ^ 

The total amount EISO is chafed for conducting -a given sedmch Van 
J^e confuted by totai^^ing charges for the three components. For exanple, 
if a'15-minute Search of ERIi; \jere condycted on SDC ^s 'ORBIT to pfoduci^ a > 
-.75- item bibliography, the charge for. one -quarter hour of data .Base connect 
time at $35 -^per hour would be $8'. 75 , the charge for one-quarter hour of • 
telecommunicatians on the TYMSHAI^E net^vo^=k would be $2'r50,' and- the charge 

,fbr printing 75 citationjpii alTTTOS per citation \^?ould be $6*00, for a 

ERXC''" $17,2^, exclusive^ of staff an^ overhead. •'^ V ^ -\ " ' 
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!i:^LE 4d -- CHARGES FOR TELECONMJNI CATION AND- DATA BASE CONNECT-TIME 
• AND. PRIOTING OF CITATIONS' BY SYSTEM^ 



Item 



LIS ^- DIALOG 



SDC ORBIT 







. *■ > 












TYMSHARE- 


$ 8, 


,00/hour.,- .•- 


$10.00/nour 


TELENE? ' 


S. 


. 00/hour ■ ■ 




Data Base^ 


- 






ERIC 






: •■- r- •• • . ''. ■ 


Connect- time • ' 


'. 25; 


:OG/hour ■ ^ 


-35 .00/nour 


Citations 




. 10 /citation 


.OS/cx^atxon 


PdzfohoZogicat Abstraats 






. ■ s 


Connect- time . , 


50. 


.00/hour 


n/a 


Citations * 




. 10/citation 












^ Connect- t3jne - * . - . 


. 70. 


.OO/hour ; 


n/a 


Citations 




."lO/citation - , 




. Dissej*ta-^on Abstracts 






0 


' • Connect- time 


55. 


. OO/hour 


. n>ta 


i - ' * . ■ 

/ Citations 




. 12 /citation 


..1 



•'^Figures:. as, of-Jaaiiary 01, 1977. 

^Data-jbase costs given for the. four that are searched most frequently by 
EISO. " J - ■ ^" ■ 

' ^ Ideally, one would like to be able to^ estimate' the- cost o£ thi'S -sam^ 
search on Lc^khee'd's DIALOG -in order to determine -which system is more 
'efficient.- Then it would be possible to malce a rational' .selectiOTi between 
. the two systems- for .searching-' ERIC. ' lfefortimately,---it-is difficult to 

- conpare -die cos$:s of searches done on one,, system with those done^on the 
other because the systems differ^ in their responsiveness, with ORBIT - 
being considerably faster than blALOG.- , How much, faster can be inferred 

- frcmi ourx^fexperience during EISO's first' year, during which the search^ 
analyst. conduc'te(i»500. ERIC searches on ORBIT and 62 on DIALOG. The - " ' 
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average connectr time for searcKes using ORBIT was 10.38 minutes; compared 
-with IS". 42 minutes losing DIALOG. Thus, it woulii ■ appear that a search on . 
DIALOG tajces approximately 46% more time to complete' than one' on ORBIT. 
It should be en^hasized that' since -these data were collected" for the ; 
period July 1975 through March 1976,, the 'situation 'may now' differ, though 
our subjective impression- is that it 'does hot. , . - 

- /-- --j^lying- the~46%: adjuslhnent -t^ 

us to draw a comparison as to what Lockheed would have charged for the., 
'^'ame search. Instead of 15 minutes connect- time, 21.90 minutes would 
have been .required. At $25 per hour, this translates into a charge of 
$9.13- for data-base connect- time. Communications charges on TELENET " 
.would, have been ^$l-.g5 .and print charges would have, been $7.50. . The' tdtal 
charge would therefore be $1S. 48,. or .about 7% more than the cost on ORBIT.- 

For <qnfan volume users, -the comparison would end here; however, 
-Lockheed now offers users a monthly discount on data-base cdraiect-time^ 
'charges according to the c.onnect-hours logged (Appendix D) . Large volume 
^ users -are entitled' to szi even greater discount if they sign a contract ■ 
gu^anteeing.'a minimur^. level of usage. Given EISO^s current volume of 
searching- "on Locldieed (about 20 connect-hours per month) , it can be - . 
^expected that the discounted cost of searching ERIC on DIALOG.. will be 
■ a^Jproximately. $18 per hour.- Hence, the charges for data-base connect-, 
time(in^the example above would be reduced to $6.66, and the total to 
$16.01, which is- 7%. less : than the search w.ould cost on ORBIT. 

Overall, it appears neither -systbin- has a , decisive advantage in 
terms of cost". Loclcheed's/-discotDnt system does .fayoinr-use "of that system 
alone, however, since the size of the ^i^scount increases -with the. number 
of hours the . system is.iised. . This mode' of charging, combined with, - 
Lockheed's wider selection of data bases^in the -social sciences, gives • ^ 
it. a decisi-vQ? advantage oyer SDC as far 'as EI60 i^ concerned. - ■ - - . 

a ' Table 47 reports the actual cost? to EISO of seardies conducted by . 
"eISO daring its two years, as" well as. "the percentage of clients .who" paad 
for their searches-. Jn the first year, -an average of 52 searches wer^: 
\conducted:f)er month.. On the 'average each" search required 12 minutes of 'r-- 
connect- tijne. to 'either ORBIT- or ^DIALOG and 'resulted in "^a. bibliography of 
46 citations: In a typical month-, ^7 or -71% of the clients paid for their 
. searches.- During EISO's second year, an average: of 36 searches were con- 
'ducted per-month. The average searih required -25 minutes of connect-time 
and produced' a bibliography c^^SB items, and cost vEISO -^25 in charges for 

— . v.' " . ^ ' . ■. ,79 - C-' . -■ CGlOl 



TABLE .47'" SEARCH VOLlllE, AVERAGE CaiPUM COST, AND PERCENT PAlD BY M)NIH AND YEAR 



''Month and Year' 

* * 


Number of , 
'Searches 


• V * « ' ■ ■ 

Average Connect( Average Iiinber Average'Cost 
time [minutest of Citations' " toEISO • 


•Paid 
•' ' Number _ 


4 

1 

■ % 


,' Year-1' 


-/—'-^ 










* 


' June 1975 


11 


• -) 

12 


' ■ 23', 


'fir. ■ 


. . 5 

> 


■45 ' : ■ 


My ■ , . ' 


■ 70 


■ - ■ 12 ' ''^ 

/ t > 


45 ■ 






70 • •• . 


August ■/ v ^ 


:37 


1 

■ 10 , 


' '47 ^ , 


; , • 13 ' _ ■ 


28 


76' 


f 

September 


'38 


9. 


. 47 


' ' ■ i2"i ; 


> 29' ' 1 


' 76 


0 

' October 


■ 55 


15''., ;. 


■ 49 




40 ' . 


■73 ■ . , 


■ * 'November 

V 


52 


17 I ■ 

\ 


•'48/ 


.22 


40 


77' ; 


X 

.December .. 


•; '^5 


-1 


f 7 


• 16 ; 




















.-.January 1976 


■ 61 


. . 10 . 




, 14"' 


44 




■ -Febniar}^ , 


, 61 


• 13' 


^ 60 


15 } 


•^^ 51 ' 


84„ 


, Marcn 


03 


\ ^ ' 15 • . 


43' 


16 


■ 4.6 '■■ . ^ 


73 -. 

r 






.■ 14 ■ 


53 


17- ^ 




» 


^ • , Average 


"52 


12 ' ••' 


46 . 


\ 

15 s' 


'11 ' 


71,' _ ■ 



TABLE 47 (Cont'd.) . . 



-mA Vmt. Average Xonnect- 'Average Number Average^Cost 

muianQiear g^^^^^^ time- (minutes) /, o£ Citations toElS^, 



Paid 



tober 



Year 2 , 



s 





29 


21 ■• V 


o2 


21 






June 


_ _.o:>..:::.. 


-V- 21 , - 


■.,.10 ...i,.^ 


.,.._24......:......^ 


. . . 28 _ 


- 85 , 


July ■ • 


.37 


. "30 , , ' 


100 /: 


25 


• 26 • 




August 


28 


It 

- 27 , \ . 


76 


26 




, t 

. 68 


/ September ^ 


27 


26 




11 


23 " 


85 


October 


•55 


. h \ 


111 


• 27 




'91 


November 
December 


43 

* 


■ •• 
■ 21 


97 

lis 

1 


, 26 ^. 
25"''- 

• 


37 ■ , 
. 29 
32 


t 

88 . 


Januaiy 1977 


34 

» V 


'Z6' 


106 


27 


' ,94 


Februaiy • 


44 


■ 27 ... 


94 




40 ■ ' 


91 


Average 


36 - 




88 k 


25 


31 . 

♦ 


• 86' 
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coimect-timc and print charges. Typically; 31 or 86% of the clients paid 
for their searches. <^ - 

• Data for the two years vary considerably. The differences are . 
e^qDlained by several factors, including, the use of different systems ^ the 
different styles of th^ two search analysts, and the reduction in number , 
of free searcties. However, for the puiposes .of this chapter, it' is not 
the reasons for the differences^ thai; are inporfant, but the impact of. 
„ — -theses-variations^- on ^ the^ cost- of -providing --the search -service . - We- shall — 
return to this point A^jter. ' . ^ 

Qne final factor influencing costs of searching data bases "should 
. be noted; ^iamely,^the exchange rates of Canadian and U.S.. currencies. 
With the recent CMarch 1977) decline in the value of the Canadian dollar^/ 
to $.95 U.S., eadh of tiie figures in the preceding analysis shoiild be 
increased by 5% to arrive at the charges -in Canadian currency; i.e.., to ^' 
$18.11 Cdn. on ORBIT, and to $16.81 Cdn. for the di^c^unted rate on 
DIALOG. If, as some predict, the value of the Canadian dollar 'drops tp- 
$.90 or $.85 U.9>>,,,^^ the charges would increase accordii^lyl* 

Staff- Costs / . - 

, The Educational Information System for Ontario " is currently staffed with 
. only* two individuals, a search analyst who is classed as librarian II, 
and a Library Assistant II* The search analyst's tiine.^s- fully devoted 
to conducting searches and managing the service, whereas the library 
assistant's time- is split between the provision of ^ secretari-al services - 
.to support the search service, and the. operation of the article and micro- 
fiche duplicating services. Their salaries are apprbximaf^y $13,500 ahd 
$7,500. annually, or $14,850 and $8,250 after including an additional 10% 
foT fringe benefits. Hence, the salary bill for the search service is 
, $18,975, including the full cost of the search^ analyst and half ^that of 
\ the library assistant.^ "The* -salary cost for the duplication service, is 
$4,125. ' ^ . ' ' - 

The cost per search' of providing staff can be est-imated several ways. 
At one extreme, the total cost of , Salaries can be divided by the totskL 
number of searches for a given period of time. Jji 1976, 524 searches v/ere 
conducted; the cost per search for staff would therefore be $36.21.- If 
only-.. the search analyst's salary and fringe benefits were included, the 
' figure Tvould be $28.34. The lowest estijfnate -of cost is obtained if only 
the time of th^e search analyst devoted to conducting search interviews , 



planning search S'^Jategies, and runn^g searches is included. .In EISO^s 
first year, the average time spent to interview clients vr^s 25 minutes, 
followed by 12 minutes on the computer system, for a t<^tal 'of 37 minutes. 
At $7.43 per houih (including fringe benefits), this am&unts to only $4.58. . 
In the second year, when the search interview averaged 35 minutes and con- 
nect time 24 minutes, for a total of 59 minutes, the equivalent estimate 
o£ cost per search for the search analyst's time is $7.31. 

^ It is our feeling that the full cost of the search 'analyst 's salary 
and half the cost of the library assistant's salary should be included. in_ 
the analysis of costs per search in order to fairly represent liie full 
cost of providing searches. Only in this way can. the cost of time required 
for demonstrations ^training, administration, and vacations be -.i^rly rep- 
resented. . . 

- , \^ 

Materials .and Supplies ; 

EISO prints a large r\r-:. .^^ of brochures and business forms in the course 
of a year p^^dadice^^ ' j . ^The pi^ai^ting of approximately 25,000 brochures, 
at $.04 each, costs $1,000 and /1, 000 copies of each of the four multiple- 
copy order forms cost an additional $800, half of x>aiich^is attributable 
to the search service and half to . the duplicatic^ service. Additional 
expenses are incurred in preparing notices of changes in the system which 
are sent to clients, etc. XVe estimate the full cost of these to-be $600, 
»all of it attributable 'to the provision* o£ scarc'^oSp' 

^ 'Office supplies, including special -pp.peT - .ed^in .the computer 
terminal', vary with the number o£^ searches completed, as do costs for* 
long-distance telephone calls for contacting lients, which we estimate 
"average $1.00 per search. The cost of the d: vect outside line for use ^ 
^in connecting the term^^al to tl?e ^^irxeval system is fixed, hwever, at 
$300 per year. Cost* of postage for mailing brochures is approximately 
^$360, viSiile the cost of nailing biblic^aphies depends on the numbers" of 
orders.* Among these costs ^^r ma-fe^rials apd supplies, only those for 
brochures, order foims, a telej^one line, jand the mailing of brochures 
are fixed. The cost of supplies and printing for providing a drqplication 
service for back-up materials are all variable, in that they depend on. 
the nimber of orders. Si:^lies themselves cost approximately $. 10 for 
microfiche duplicate^.. and $.04 each for paper copies of journal articles. 



Capital Expenses . ■* • 

EISO has invested $3,700 in the purchase o£ a coirputer termin^l^for use in 
conducting searches on ORBIT and DIALOG, and $5,440 for a microfiche printer/ 
processor in order to) be able to provide copies o£ ERIC microfiche, TTie 
usual replacement cycle for equipment at OISE is five years; therefore, 
thev equipment EISO uses has. an imputed .cqst of $740 per year for the V 
search service and $1,088 for the duplication sprvicef A .machine fo^* ^ 

-.photocopies of j oumal^ articles .was made . available Vl3y._ the Institute; _there- 

fore its cost is included in ^overhead. ^ , - * 

0"verhead and Total Fixed CoiS^s " 

_ - ^ \- . 

The standard estimate o£ overhead cost used at OISE is. 25% o£ all budget 
items. Tho^e items listed to this point -- ^ta££, Tnaterial and ^i:rpplies , 
and capital -- total $22,575. .Overhead costs of $5,594 should there- 
fore be added, making tha total fixed cost of ElSO's^earch service 
$27v969 per year.- Tliis, in essence, is the fulO/cost^jf offering the 
service even if no requests are received. -/^ - • ^ 

iThe overhead for the pISO duplication servide- is '25% of $5,613, 
which is the cost of staff, materials and supplies, and capital allocated 
foi^ the purpose. Hejjce, the total fixed cost for, the duplication service 
is $7,016". \ . ^ , ■ • ' 

- ■ - ■ ^ . ■ _ 

Costint^ Si. Search Service ^ - 

This section develipps a series of models "for- estimating the cost o£ biblio- 
graphic search services that differ in several vi-tal ways, such as the 
number of searcli analysts, the amount of computer connect- time used to 
complete a search, and the length of resulting bibliographies. The first 
step in carrying out tlii^ analysis is determining the fixed costs q£ 
search services wxth one and tiv^o search analysts, respectively. The ^ . 
second step is deteimining tTie costs of three^ different se^ch services 
all of which have one search anal^^^ut differ in the types of searches 
provided, and hence, in their variable costs. Finally, the analysis o£ 
variable costs is . extended to a search service with tavo search analysts, * 

The monthly cost of a computerized search service is dependent ijpon'. 
both fixed costs, such as staff salaries , ^ and variable costs, siich as 
those related to the amount of coirputer time used and citations printed. ^ 



the basic. tmit for the analysis of these costs is the individjjjL-" search, . 
and. the object e£ this analysis is to' determine the average .-cost 6£ SL 
'search,' IMortimately, it is quite .difficialt to defaaie exactly . what: "a 'J 
■search is and to ensure"^ thatlthe ded^ition is applied consistently. -. 
y- The problems with defining ^ nt^aningjof .a search are , suggested . . 

b>c Wange*,^ aZ'.;- (1976). \. -. . ; . ' ' ; . ••' 

- '. ' Do most . ^ [search analystsl/.ccbsider-.a^searcii . ' 

' .to, be the' interrogation of one' ^ta/ base,, or ido ^ • ;. 

*■ % they consider it to be the . intefi^atioDj of as .ma^^ 

* i; - data ba^ps as are needed/ or xised,'^^/^t'isfy^one_^^^j; 
*' .' search' request? . ' v ' ' ".. . ' r^^--'J 

' 'twere "does a search begin and end?.- For exanipie^ 
is- logging- in time included?- The .entry cSf maxliaj 
. ' - i^iformation for an off-lin& printQut? .'head. 

: ■' ' '-" scratching time when the seai^er' is deciding what / ' ^ 

- > to do next? * J. 

- Does" time -"at the tferminal" include periods when 
■■ K ' the searcher leayes the' temainail to check a . vocabu- 
' * lary guide or user manual? - ' ~' . * 

- , How many different teinminal sessions are reqiox.red- 
, - --"'to satis^ a single search request? . Somfe ... 

- ^ [search analysts] indicate that they may .check • 

their results x^rith the - . . [client] as an iater- 
raediaiy step before finaMzing the search,- or that*- 
they offer to re-do the search if the . - . [client] - ■ ^ 

feels that it is not exactly what he or she wants . 
Is the time for each additional terminal session 
considered as part of jiost one-»4*search"? CP- 82) 
Regrettably the " inpo'rtance of the . definition o£ what a search is, was noT 
fully- recognized at the "beginning of EISO's activities, and a- standard 
'definition was riot set imtii the second year. .Now, _a search is defined ^ 
to be the composite of the search analyst ^s interview with the client, 
the work devoted to designing a search strategy, and the interaction with 
the' corapiJter system to locate materials^, regardless of the nuniber of data 
bases searched- A search must' also be devoted to one topic, wit±i. the 
. .s^rch analyst making'"the judgement as ^ to when a change in topic occurs. 
For exaiTple, if an inteiview session devoted to a search on moral educa-^ 
ti^ at the elementary school level reveals the client is*" also interested 
'in- -the deviant behaviour of elementaiy school . children , then the-~ search 
-analyst would^ indicate, to the client that since the second topic .requires 
:an entirely n^ seaych strategy, a second distinct search.would have to - 
be undertaken. • . . ^ ; . % ■• 

-During EISO's first year, a somewhat lo9ser definition of a search 
was used. Informal demonstration searches were counted knong'1±Le searches 
condudted, and if a search required use of two different dataObaggs, the 



search- o£ e,ach. data^b^e was' counted separately.^ As a result, the reco:j:d 
^o£ the number of Searches conducted during the first year is somewhal: , 
• inflated in- cOTiparison to that for the second year>,while -thfe average - 
tims spent cm .the computer in the £^rst year is probably underestimate^^ 
siiice thejaiHount o£ -connect- time for each data " base woujd have been 

recorded separately. ' " r « • ^ . , » . 

In'^ite of the^difficulties in defining the -meaning of a search 
and detemming the lengtBr^.of time, each search taJces,- the data that have 
. teen collected are sufficiently precise 'to be vs'e^^ as reasonable guides 
to the amount of time that is ^reqiaired for a typical search,- and to the 
- xiyii&?eT of searches 'that can be reasonably conducted in one' month. Also, 
« the. data for- the number of preferences printed for each search are exact 
since th^ can be determined without ambiguity, from the conputer printout. 
HeJice, vre have a good basis for maJdmtg^, reasonable estimates of the three . 
•basic parameters that detexmine the variable costs of operating- a search 
service:- con?)uter connect- time, number of citations printed, and" number, \ 
c^f seai-dies conducted per m:onth. ' • , . _ ' ^' ■ 

• The data for ElSO^s two years provide different estimates of these 
three parameters, however. 'As shown in Table 47, the average conputer 
connect- time the first year was 12 minutes whereas it was 25 minutes the 
second year. Even restricting the time estimates to searches conducted 
on DIAbDG provides widely varying estimates of the connect-time per search: 
15 minutes for the first year and 25 minutes for the second. • Judging from 
tbe different amoiiits of time spent on-line, it appears that the two search 
analysts had considerably different styles of operation. For this^ reason, 
" vtiae revised model of search-system costs includes several estimates of the 
average amount of computer coraiejct-time used during a search. Three values^ 
^re Selected to r^Jresent what we believe to be the minimum, n^dian, and r*" 
ntaximmrt values one can expect. The values stelected are 15* 20,' and 30 ^ 

iniHUtes respectively. ^ ^ 

The idea of using ^:^ee^ different estimates of consptxter connect- time • 
in the model rather 'thanT a single estimate is repeated for another para-. 
. jQ^ter *bf interest, the average number of citations . . The first value selec- 
ted was 50 citations per search, whidi is the average length of biblio- 
graphies, prirfted during EISO^s first year. The. other values were 75 -and . 
100 citations, values which enconpass the average length of bibliographies _ 
for'EIso*s 'second year, whicJi was 88 citations- . • , 

ERIC - • ' 



^ Eor convenience, the- fiTst o£ the three models presented pairs 
bibl^^Nphies containing 50- citations with searches taking 15 ^Siutes of 
^ ' connect- time; that is, it is assijmed 'the average search, reqiiired 15 minutes 
\ of connect- time -and produced a bibliography with 50 citations . ' The second 
b^. model pairs biblidgliapMes of ,75 citations with searches taking 20 minutes 
'of comiectrtime; and the third model pairs bihliogra^hie's of 100 citatioas' 
^ with searches taldng 30 minutes of connectjtime. 

" • EachVof the three models provides a picture; of the -economics of 
* operating a search system that has fixed costs -j^etermined by the requiret 
' ments" for sii^jplies, printing, capital,, staff, rand oyerhead, 'and variable ^ 

• costs determined by the average amoi:i^t of timb that is spent* on-line and 

• the average length of bibliography. ^ " . s -. 

Fixed costs for operating a search service with one or' two search 
analysts are' reported in Tabi^ 48'. The -f ixe* costs for a service with 
one search -.analyst is $2,331 per montli, that for a" service with 'two - 
. search, analysts- is- $3,878 per month. The^ latter is 55%- -^eater than 
•die former, indicating it is more . ec6nomical to add a\second search 
analyst to an existing "service than to create a second^search* service. 
The savings would amount to 34% of the basic "fixed cost or $782 per 
month. . 

Variable costs and fixed costs for searches are add^<'together in 
Table; 49^ to. give -total monthly costs for three search services eac±L with 
one search analyst but using different amoxmts of computer time fdr each 
search and producing bibliographies of different lengths. Since the, - 
total cost varies with the number of searches completed, data on costsv 
are pi'esented according to' different levels of demand ranging, from zero 
■"'searches per month to. over 100. For example, a search service conducting ' 
, an average of ■.40 searches per month, each requiring 20 minirtes C- 33 hours) 
of computer connect- time and yielding bibliographies with an average of , 
75 citations each would incur costs of $2,984 per month; If clients • 
were charged $30 per search, as is currently, the case, *'$1 ,-200 in revenue s • 
would 'be " generated, thereby leaving ^ monthly deficit of $1,784. The / 
actual cost of each search would be $74.59, witl^®.27 due to 'fixed%>st^; 
. ,and/$16^33 due'. to variable costs. A fee of $30 per search would more ^^^han- 
- coyer the variable cost, but would still leave a deficit of $44.29 per ^ 
search- • • 
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TABLE 48 ---FIXED COSTS PER MONTH FOR OPERATING 
■ ' SEARCH SERVICE 



V 



Budget Item- 
\ 



Number £>£ Search Analysts 



One 



Two 



T&Ze'pyuDne ccnd Telegraph ' ' 

» si- ' 

Outside line C$300 per year) 



$ 25.00 

^ - r 



$ 25.00' ^' 



SzcppVles and "F^ht-ing ^ 

Brochures and business fo^ros C$2., 000 . 
per year) 

Mailing costs for brochures 



166.67 
30.00 



166.67 
30.00 



Staff r , .' * L r 

: Librarian II C$14,850 @ full year including ■ 
fringe benefits) 

Library Assistant II Chalf-time @ J8,250 , 
per y^r including fringe benefits) 



1,237.50 
343-75 



2,475.00 



343.75 



Capz-taZ ' . 

Conputer terminal C$740 per year) 



i 61.67 



61»67 



Overhead 
- 25% of above items 



4.66.15 



TotaZ -per Month 



2,330.74 3,877.61 



Total per Year 



27,968-88 ' . 46,531.35 



ERIC 



88 



CO 5.1^^-- 



W 49 ■• fflDE COSIS m MBffi KM FOR BIBlIOQffllC.SHffl SpiflCE' ' 




»>330.7* $2,330.74 ■ J2,330,.74 $2,330;74 : $2,330.74 J2;330.74 |2,m75. 



7mabU Costs 



Teiephme 5 Telegraph 



mS£VoS-- .25hr/s 0 , §00,00 • 200.00! , " 280.00 36.0.00- J25.00> ' ^mM 

•nect-tiiiie.oii;$200 ,.33 hr/s ,0 • 

miniiim lEonthly . - '30 hr/s ^0 

contract) " . ■ , ' , 

- IHffi ($5'per '.25 hr/s, 0 • 

hour) r , ' .33 hr/s \ 0 

. ; ^ . ; .'soMs 0 




2oo;oo 

200.00 . 


. 232.00' 
360.00 


356.80 
490.00* 


443.20 ; 
620.00 

i 


' 529.00 

730*):^^ 


2S;oo 

33.00 ■ 
■50.00 


50.1 
66.00 
100.00 


75.00' , 
99..00 ' 
150.00 


' 100.00 ' 
i 132.00 
200.00 ■ 


125.00 
■ 165.00 
250.,00 • 


20.00 ' 


, 40.00 


60.00 




100.00 ^ 


7.50 


' 15.'00 


22.50^ ■ 


< 

30.00 ' 


\ 

37.50 



150.00 
'198.00 



' -Mthly Telephone • - 

■■ (Long distance for. , ' j 20.00' 40.00 60.00 ^' '.80.00 ' 100.00 / 120.00 
. contacting clients 
@$1.00, per seardi) ' 

•Suppliesr^ Printing ,■ 
■ - Temin^ paper ' ■ 

'($7.50 per roll; ' '• 
20 searches per , 

• role) ' . " , ■ 

- Off-line T^mting 50 cit o' lOOiOO 200.00 300.00 400.00- 500.00 600.00 

Sto? 7 d ■ 150.00 " 300.00 450,00 600,00 , 750.00 . .'900. 0, 

iS * 1 S ' ■ 2f00 400.00^ 600.00 800.00 1,000.00 1,200.00 



" •• ■ .'^"V ■■■■■■■■ • 



TABLE{9l(Coi^'d.) ' . , . ' ' , 

■ '■ . , • . Nuniber of Seardies 

Budget Item.* 



. ' . . . o'.i" 20 ; '40; \ ,60, so . loo j * 1120 • . 

."• — ^ — ■■ ' ; : ^ — ; — 

«. • • . . ; ' ' • ' t. ' . . 

.Total' Cost ^ev Mi^ - IS \irls $2,m 74. $2,683,24 . $2-,851.74. $3,068.24 $3,300.74 $3,418.24 J3,735.74 
. , ' • . .33hr/s 2,330.74 ■■'2,74i.24' '2,9804 ' 3,319;04 3,615.94 ^3,812.24 ' 4,208;'54 " 
■■. . .■ "^/.'SOhr/s • ^2,330.74' ^2,808.24" • 3,24S.7f 3,653.24 4-,060.74. 4,^348.24 ,4,835.74 

■ • ... , . . • V ■ ■, ' V ' ;■ 

' '^JOpgrteV, . . 0 ■ , 600?«0 1,2Q0:00 1,800.00 2,400.00 3,0'00.00. v3,600.00 

i Profir ftej ■\'25 hr/s, (^^ (1,083.24) - .(1,651. ?4) ,(.1,268>24) (: ,900.74) ( 418^^) ■ t 135.74) 

• • ' '• ■ • . .33 hr/s ' (2,330.74) ■ (2,141.24y (1,783.74) , (1,51^.04)' (1^215.94) '( ,812i24). (• 508.54) 
■ . .SOhr/s' (2,330.74) (2,208.'24) (2-,045.7fl (1,853.14) «(1,660. 74) ,(1,348.24) '^(1,235.74) 



Cost "pev Sesrsh . . ^ . ' . ' 



Fixed Costs .] \ , ' 

* , 


0 


, 116.54 


58.27 


■ 38.85 


•'29..:3 


23.31 


19.42 


Vari^le Costs .'25 lir/s 


0 


17.62. 


. . .13.02 ^ 


12:29^1 


\ 12.13 


,10'.87 


* 11.71 


. ■ ■ ■ .33 hr/s ■ 


. 0 


20.52 


, ' 16.33 


• 16.47 


' . 16.07 


14.81 


15^65 


' . ■ , '■ ■ .50 hr/s 


. 0 


■ ■"23.87 


•V. 22.88 


. 22.04 ■ 


21.63 


,.20.17 


,' 208 


Total Cost 'per Search .25 hr/s 


0' 


134.16 


71.29 . 


. 51,l4 


41.26 


34.18 


3l)i3 


■ , ' .33 hr/s 


0 


■ 137.06 


■ 74.59 


55.31 ■ 


45.20 


.38.12, 


35:07 


.50 hr/s 


0, 


■■ 140.41. 


. tl.l4 . 


60,89 • 


' 50.76 


43.48' 


4O..:30 



■ Cost per'to _ ■ . • / . ■ ■ , 

/ • Fixed Costs ' .-- 27,968.88 " 27,968.88 27,968.58 27,968,88" ' 27,968,88 27;968.88 ^7,968.88 

Variable Costs . ' .25 hr/s 0 ^ •.4,230.00 '6,252.00 'SjSSOXlO 11,640.00' 13,050.00 .16,860.00 

}■ . ■ .33hr/s 0' '4,926.00 7;836.00 11,859.60 ^. 15,422.40 17,778.00 .22,533^. 

. . " ..50.hr/s ■ 0 5,730.00 10,980.00 15,870,00 20,728.88 , 24,210.00^.30,060.00 

Total Cost per Yeai .25 hr/s 27,968.88. 32jl98.88^" ' 34,220.88 36,818:'88' ,39,608.88 41,018.88 44,828.88 

• , .3nr/s' 27,968.88 32,894.88 . 35,804,88 39,828.48 . 43,391.28 45,746.88 50,502.4S 

..50hi/s 27,968.88 33,698.88 38,948,88 43,838.88 48,728.88 42,178.88 58,028.88 



— — ; — — ^r— , :\ . ' ■ , 
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• The data recorded in Table 49 are presented graphically in Figure^ 5.. • 
The searcii , service whose Inputs are described above is indicated/w^ a 
blaqk dot^ l^le none o£ the services described in Table 49 break ev^^- 
"^regardless o£ the level o£. demand, the ^raph indicates that a service 
usojig only 15 minutes of connect- time per search and providing bibliogra- 
phies vath 50 items e^ch would break even if it charged $30 per search. . ^ 
and conducted^ a trace over 120 sea:Q^es per month.. The*. three dotted lines 
in Figure 5 represent the three different models tabulated in Table 49* 
CcOT^arison of the three -Indic^-te that at . lower levels of demand^ the 
nuniber of searches conducted has, a greater in^apt iipon the cost per search 
than d6es the amount o^ conputer cprniect-time used or nuni>er of citations 
printed!,' At higher- levels of demand, the latter "two factors become more 
important. This finding' ijT5>lies that a search service wishing tWminimize" 
its cost per search should first concentrate on increasing demand, and 
later concern itself with reducing variable costs.- ' - . 

The three sample search services detailed in Table 45 and Figure^ 
are, of - course^^^ jus^^reie ^possibii^ities out of an -infinite number of 
alt^natives. One need only change tihe averag^^length of computer connectr- 
.time and the average length of bibliographies in OTder to determine alter- 
native costirig models. . ^ 

" The lines graphed' in Figinre 5 .representing the various costing models 
are not . straight lines: They change slopes slightly diie to the inpi'^ct of 
the discount schedule that LIS uses for determining charges. In general, 
rates descend as the cumulative data-base ^^c^nnect-time used per month 
increases* This decline in price 'as usa^e rises is part^i^ularly pronounced, 
if a contract for a guaranteed minmim amount of coraiectytime is in force, 
as is the case in these exairples -which assume that a' $200 minimum monthly 
payment has been guaranteed. * -This guarantee corresponds to'^the agreement 
that EISO has signed. T t 

TVhile the cost of computer connect-:5^e decreases as -usage increases, 
the cost of citations remains constant. Hence, as the cumulative time used 
increases, the length of bibliographies becomes more inportant than the 
amount of coiinect-time in determining the cost, per search. This fact . 
implies that services ivuth large- numbers of clients should spend more time - 
on-line in order to develop refined search strategies that yield shorter 
and more selective bibliographies, rather than accept lengthy bibliographies 
with few relevant citations such as those that 'Soften result from the use of 
an inadequate search strategy. 
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Cost of two search services, 



^ each with one search analyst. 



\ 




0 



^gff ■ 20 ndnutes/siearch; two sear^ 



analysts 



0 



en 



33 

0 



30. minutes/search ^ ^ 

. ' • • -20 minutes/search 

■ 1 . --•^•SJ?^ 15 raimites/search 

' ■ ^ fMSM^MMM. Search" service vdth n 

Search, service with one analyst 
, ' ' ^ I ■■MMMH Income at $30 ^r search 



20 



40 



'60 



80 100 120 

Searches per Month 



140 



160 



180 



200 



ERIC 



113 



Provision of a second search analyst to a search service (Table 50) 
increases the size o:^ the deficit jlicurred, as c-an be seen by con5)aring 
" the line Showing the 'monthly cost to£ a service with on^ ^search analyst 
^ vdth that showing the cost for a sefwace ^^^ith two search analysts , 

assuming in each case that a typical sg S c iiA i^ uires ^20" minutes of connect - 
^ time and produces a bibliography of 75 items (Figure. 5). . Of course, for 
' <q>efations ^with many requests there may be ho option but to add. a second 
search, analyst • At the same time, it should be noted that addi^ig a 
K * search analyst to an existing service is far more economical than creating, 
^ a. second .search service, a choice whirfi would mean the 'doiibling not only 
of the salary of a search ^nalyst, but of ^pther fixed costs as well* The 
cost of operating two search services is so greaj: that only a smsill por- 
tion of the graph for its line can be displayed in Figure 5. Monthly, 
deficits for search services with one and two analysts are $1,519 and 
$3,066 respectively, assuming that 60 searc±ies are completed per month 
with each requiring 20 minutes of connect- time and producing a biblio- ^ 
graphy with 75 citations* The mont±LLy deficit for two separate search 
services with a combined volume .of 60 searches per month. would be $4,838. - 
Clearly, it is more economical to increase the size of an existing search 
service than to create a new one. 

In simmary, the major factor in ' determining the cost per search for 
a bibliographic search service is' the level of demand. When the number 
of re<juests; is less than 60 per rndfith, the fixed costs dominate the cost 
equation, and the greatest reduction in the average cost per search can 
be 4?con5)lished by increasing 4the volume .of searches. At high levels of . 
demari^i the length of time spent on-line and the length of bibliographies 
become the most important factors . Additional search analysts inor^ase 
the cost per search substantially, but if additional staff are neieded, i% 
is far more ^canonical to add them to an existing service than to create 
an altogether -new service. ^ ^ 

, Level of Demand 

The voliraie cxf search requests that a bibliographic search service receives 
has been identified as a major factor in determining the average cost per 
^ search. It is therefore important to know both the overall demand that 
the Educational Information System for Ontario can expect;, and the volume 
of requests that one search analyst can handle. 



Costs 




Mxt of Searches 




J3,877l61 'J3,877;61 J3,877.61 $3,877.61 55,877.61 «?,877.61 



Yonable. Costs 

Telepte § Telegraph 

^-Lo«(Costo£m 
caiputer connect-time 
at .35 hour per search) 

■ MET (J5 per hour) 

•4 ■ " 

' - tothly Telephone- (Long 
distance for contacting 
„ clients Ml.OO per \ 
search) , 

Si|)plies and Printing 

, - leiminal paper ($7.50 
per roll; 20 searches 
per roll) 

- -Off-line printing of 
citations (at $.10 ea., 
; 75 citations per search) 



r 



356;80 


'443.20 


,529.00 


' 614.80 


688.70 


760.80, . 


833.40 


99.00" 


132.00 


165.00 


198.00 


231.00 


264.00 ' 


297.00 


60.00 

If ■ 


. 80'. 00 


100.00 


i20.00 


140.00 


160.00 


180.00 

» 


_22.50 


30.00 . 


^ ■ 37.50 


45.00 


52.50 

* 


• 60.00,^ 


67.50 

• 


450.00 . 


600.00 


■750.00^ 


900.00 


1,050.00 


♦ 

1,200.00 


1,350.00 



'mi^,Mi:] ■ • • ^ir of searches 



mm'^m& •■:>■:■ J5;55.4i .$6,039.31 }6,3M %m 



"^^ost per SedKh 



^ Fixed Costs . 



Variable Costs ■ 
Total Cost per Search 



Fixed Costs 



Varittile Costs 



. : 2,400.00 3,000.00 '■3;600.00 4,200.00 4,^0.00 5, 



J ■ ■ ■ . . . . 



m,m(M- :,: .13,065.91) (2,762.SD (2,459.11}. (2,155.41)- (1,839.31) (1,522.41) (1,205;51) 



H.63 48.47 ' 38.78 ■ 32;31 -27.70 ■ 24.24 21.54 
16,47, ., 16.07 lS.8'l 15;65 ■ 15.44 , ' 15.28 ; .15.16 
81.10. 64.54 .54.59 ■ : 47.* ■ ; 43;14 39.52 ' 36.70 



' ■ 46 531.32 46,531.32 46,531.32 46,531.32 '46,M •*,531.32 
. 11,859.60 15,422.40 18,978.00 22,533.60 25,940.40 29,337.60 ^ 32,734.80 
. : Total tetlr Year' ■ 58,390.92 61,953.72 65,509.32 69,064.62 ,72,471,72 -75,868.92 79,266.12 ' 



The jwtential demand that /EISO can expect remaios "uncertain. If - 
all boards and facialties o£ education used the service as heavily as do 

some, the potential is very "great indeed. However, a. majority, of Ontario. 

school "bbards-' arid faculties of education have yet to try the s'ervice. 
Given the degree of uncertainty that results from having a large number 
of potential clients but .-relatively few regular clients, we are -unable 
to project a maximum level of usage that could occur. Nevertheless, we 
are "^ronf ident tiiat the potential level is at least twice that experienced 
to date, i. concli;sion that we shall explain later ► . _ 

One factor influencing the level of demand is the price charged for 
searches. The relationship between price and demand is illustrated by • 
the higher levels of lisage that have been observed whenever searches were 
free. For exan^le, far morfe requests have been received from the North- 
eastern Region of Ontario where free searches were distril^uted to all 
educational agencies than one. woiald expect on the basis of populaticjn' 
alone. In fact, few of the sear^es from that Region have required pay- 
ment. i\nother example of the, stimulus provided by . free searches occurred 
in 1973, when OISE participated in a five- week demonstration ^of on-line 
retrieval od^ bibliographies. All searches were free, and in just five 
weeks 186 search requests were received. This number far exceeds the 
volume of requests that EISp has received for any period of coirparable 

length. . - 

• '. Data collected dtiring ElSO's.two years show that the number of 
requestiTaveraged. 52 per month during the first year and 36 per month 
during the* second. The average number of paid searches were 37 per month 
and 31 per month respectively. Given the . different definitions -used for 
the meaning of a search i" the two years,, the figures for paid searches ; 
^re probably con^jarable, while the overall figures suggest some, decline 
in the second year, as would be expected given the smaller number of 
free searches that were made' available. Judging from reports provided . 
by conparable search services, the volimie of requests that EISO has 
received is not atypical. Wanger, et al. C1976:) report that a survey of 
145 educational search services revealed that 45% -condixit between I and 
49 searches a month, 16% between 50 and 99, and 34% over 100, The median 
value was 58 per month, a value equal, to the demand during EISO' s peak- 
months. A siirvey of 125 search services with one search analyst, but not 
■restricted to educational Institutions, revealed. that 52^ between 
1 'and 19 searches per month, 30% between 20. and 55 searches, and 14% more 



than 55 ;searehes per month. The median niimber o£ searches^ per month for 
- . . tJiese setvxce^was just 18. Taken together, these data suggest that EISCs 
volume o£ seajfdhes is within^' the ordinary range for search services with • 
one. analyst, and that, as an educational informatjpon service, its volume 
could be e^^ected to increase to an average q£ 60 search requests per 
- aionth. It also appears that a full-time search analyst should be able to 
cope with^ this load. . & * i. 

Average risage . figures, do not., of course, reflect actual usage on a 
month to month l^asis. Data reported in Table 47 show" that demand in pealc 
months is almost double that in slack months. Hence, carrying an average 
of 60 searcliesC per month would require the conpletion of as many as 80 
' Searches in a peak month in order to balance a demand for only 40 searches 
' vper month in slower periods. 

In sirnimary, a target of. an average of 60 searches per month -appears 
to be a realistic goal for EISO- As Figure .5 and fable 49 indicate, this 
level of activity would require that the service continue ta be subsidized . 
' .at a rate of between $1,268 and $1,>8S3 per month or between $21. and $31 
^ per search assuming that the present practice' of charging $30 per search 
is maintained. 

■ * \ ^ Pricing Policy , ' \ 

£ISO*s policy on pricing has been to levy a-uniform- charge of $30 for each 
search-* Exceptions to this policy have been made to assess the effects of 
different price structures on ^ demand. .As noted earlier, agencies in the 
Northeastern Region of the province vrere provided -with both free searches 
'■arid, ivhen the free searches were exhaiosted; a reduced rate of J$20-per. 
rSearch: . Two additional short- teim experiments were also carried put. The 
first was during the 1976 graduate summer session _at 01 SE when students 
were charged only $15 per search. ,The second occurred in 1976, when 
members of Phi Delta 'Kappa were given the opportunity to pay only variable 
costs due to computer connect- time and number of citations printed off- 
line, which are generally less- than the flat $30 rate. - > . ~ , 

, ; These .pricing structures can be evaltiated in terms of both their. ^ 
effect on demand and on user opinion. .Demand is clearly related to price, 
if we include free searches as one option. However, the jump from no " 
charge, to charges in th^ $15 to $30 range seems to have a considerable 
deterrent effect, upon the level of demand.. And, judging from the f ewr ^ - 

erIc . ; .■ ■ ■ ^■\''~€oizs 



Phi Delta Kappa ineiiiber& who^ took up the offer to be, charged only the 
variable- rate, charging only for computer time and off- line 'printouts is' 

- an- equal-^e*erren-t— : -We hav^ not-Xried -charges in. the". Sl-to. .$14__range_,_ 

but suspect -Uiat token char^e^in the realm of $1 to $4 would have little, 
effect in deterring clients. This judgemei^t is based on the experxfence 
of the Tfoiversite de $herbrooke, which reported a tr^iendous increase in^ 
the volume of requests when the price of searches was^educed to just '$3 
each. Further, we suspect that the deterrent effect of jJrice increases . 
sharply in the $5 to $15 range. . ^ . . 

"^.When EISO's users were asked how. they felt about the $30 fee, 36% 
reported that they found it veiy . reasonable ,*^9% acceptable, and 14% 
excessive. This response suggests that $30 may -^ near the -upper limit v 
x)f vdiat most lasei^ are willing to pay for the service. Some' users have 
been willing to pay more*than $30, however, for exceptionally long and 
conpiex searches which require over- $50 in ccraputer time and printouts. 
In a.few cases, a surcharge of as much as $100 has been in^rased. 

Client *s c^inions about the acceptability of the price for an EISO 
search vary ^according to their roles. Using a thre^ point ^cale (1 = very- 
reasonable, 2 = acceptable, and 5 =' excessive} , the average responses for. 
clients occupying different "roles were as follows: field development, 
1.2;"' administration, 1. 6; teaching,' 1. '"7; research,- 1.7; library, 1.8; 
master* s student, 2.0; and doctdral student, -2.1. It appears that adminis- 
trators. might be willing to pay more for the service, but that graduate 
students woiild not. - : 

EISO's policy of charging a flat rate places it with a minority of 
search services. ' Wanger, et aZ. (19 7j5) report -diat only 27% of 'all 
services charge a -fixed fee, while 74% ilt^ose a variable' fee and 4^.pit^-'- 
vide the service on a subscription basis. Of those charging, Sl% charged 
for coniputer connect -time'^and off-line printouts, 6S% for comnninication . 
costs, 36% for staff time at the teinninal, 32% for the. cost of thpterminal 
31% for. staff time Cpre-terminal) , 24% - for staff time Cpost-termiiial) , and 
only 16% for overhead. ' ^ 

What should EISO^s pricing policy 'be iji the future? Should it con- 
tinue to charge a- flat fee,' or should the- fee be related in, seme way-, to the 
resources required for each ; searc±L? There are . essentially six different 
policy options: * ' . • 

1. charge for variable costs attributable to computer connect- time, . 
connrunications '.and off-line printing; , , 



2. d^rge a flat £efe to cover part of - the fixed and/or variable costs; 
3* charge a flat fee- to cover part of this fixed -costs, plus, all of the 

variable costs listed in Cl) above; 
.4. charge a variable fee to cojb^er part of the fixed costs, plus, all 

the variable costs listed in CI) above; 
*5. charge a flat fee to cover all of the* fixed costs ,on the- average | 

plus the variable^ costs listed in (1) above; and 
6, * \charge a variable fee to covex^ll of the fixed costs, plus all o£ 
the variable -costs listed in ^0 above. . ^ - ^ 

' EISOVs current policy is option X2) above, while . the policy of most 

'* ' ■ . ■ ■ ■ . 

Canadian search services surveyed in Chapter 6 is option Cl) for their 

internal, clients .anid option (3) for their external clients^jCsee Table .56) • 
' " It is our - feeiing that a single -pricing- policy is probably too res 

trictive for EISO. It may. well -be ^thg^t for some clients, * the -service. 
' should be free, whereas for others, the fiill cost should be paid- Never- 
theless, if we were to recoifimerid one option, it would probably be the 
fourth one: to charge a variable fee to cover part of the fixed costs, . 
plus the variable costs related to computer connect -time and* off-line * 
printouts. We believe the variable fee that covers part of the' fixed 
costs should be related to the length of time spent on the search inter- ^ 
view, planning the search strategy, conducting the search, and follow-tp - 
activities, this practice would bring som^ economic discipline to the - 

allocation of time on the part of the search analyst and client. Cur- 

• ■ ' * * '''' ' 

rently, a search requiring two hours of work is no more ejcpensj.ve than 
. one taking only twenty minutes. Under such a system there is no motiva- 
t:ion for spending time wisely and, since any negotiation session could^^go 
a \. on indefinitely, there may be a tendency to continue interview sessions 
beyond the point that* li^ for -iii' 

half- hour blocks ; this would be less^ likely to* happen, and all conceuied 
would be more" likely to end a se^^ion when no^new insights were /^eing 
developed. On the .other hand, we H^^bu3.d not" advocate <z3is^ by a shorter, 
time period; since such a policy might place too much emphasis OI^'^^f i- 
ciency and not enough'' on quality. :^ . * ^^"^^Z 

. • If a- policy to charge a fee for each half-hour of staff t me is 

. adopted, what should -.that charge be?' Logically., it should^ be some portion 
. . ; ; of the average fixed, cost . For example, if the search service conducted 
60 ' searches per; month, each requiring an average of .20 minutes of con^juter 
connect-- time and producing a bibliography with fin average of 75 citations. 



then the average fee should b.e less than $38.85, which is the average , 
fixed cost (Table 49). Assuming the average . search took about one hour 
for botii interviewing and searcMng, as was the case in EISO'S second 
~y^T, s^ -^t t^^ to recover appTOxim 

the fixed costs, then a rate of $12 pejr hour or $6 per^^f-hour seems . 
reasonable. ' Thu^ a typical search might cost 4,12 in staff -time and 
$16.47 iii variable charges (Table 49} fbr a total of $28.47. On the other* 
hand, a search taking two hours of staff time, 30 minutes of connect- time, 
and producing a bibliography of 100 items would co?t the client $24 in 
staff time and $22.04 in variable chargds, 'for a total of $46.04. 
- It is, of .course, jnot necessary to charge all t>^es of users the 

same- amount for staff time. ^ If it was felt that: some groiq>- could or 
should pay more^ then the rate could be higher for that'groL?). In essence, 
this is what most search services do when they "charge external users a 
hi^er fee than they charge" internal users. On the other hand, "if there 
was a desire to make the service mqre accessible to sorie category, of 
users, lien €Ie]rate might be reduced to, say, $6 per hour for members' of 

that group. ^ * ^^ " 

. . As noted above, charging users $12 per'hour for staff time would, 
OTi the average, cover only me- third of the fixed costs . This would still ^ 
leave a projected monthly deficit of between $800 and $1,200 for a service 
conducting an average of 60 searches per month. What organi^zation or 
organizations should cover this deficit? Most search services in the 
Uoitdd -states receive federal assistance, an option which is not available 
in. Canada. 'There is, m fact, ito single answer to .this question. Several 
possible options to be considered are discussed later in Ch^ter 7.' 

. - ' , * . , ' y ' ' 

Microfiche 'and Article i)L4)lication Service • ' ; . • 

^ _ ' ■ . J ■ ' ' ' '■ ■ 

The microfiche and article duplication service is an integral part of tJ^? 
Educational Information System for Ontario. Wiljiout "it, the bibliographies 
that EISO provides would be of little value to "die clients since they would 
find it difficult, to obtain original materials. Initially, the prices 
charged for copies were set very low^ ii>.order to. encourage users to pur- ; 
chase themK^^e- price for diazo copies of microfiches was set at $ . 35 
- each and that for photocopies oF'journil? artxcies^^ 
: the sections that follow, we take a closer look atthe du?)licag:ian service 
arid its prices in order to determine v*iat future policies rai:^t be. * 
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TABtE 51 'CimiVE MM REPORT FOR EISO DDPLICATM SERlflCE 
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— - — 


■"'""l\]iiiber'o£Docui3ents""or'ArtM^^^ 


: 




: 




Nuniber of 
Orders^ 








• Copies ■ 
Supplied^ 


" Total ] , 
Charge 


Average , 
Charge 


. ^ *. 


. OrdjCred 


Supplied 


— 




• 


No. ■ , 


1 

\ 








...•.June" 1976 


8. 


' 80 


78 


98 

.1 


„ • 366 


1, 7.35 ' 


$ ;:92. • 


■ ^ - ■ .. ■ 

. July , 


14 ■ 




ox 




188 


• 40.05, 


2.86 


August 


13 


103 


' 93 ■ ■ 


90 


1 254/ ■ 


■ 53.65 •' 


,•4.13' 


September • 


1*1 


' 100 


93 


93 


/jj 




iJ.JJ 


October 


: 16 


118' 


104 


88 


308 


■' 49 J * ■ 


S'.08 


', November 


' 25 ' 


/ 192 : 


' 172.. ,/ 


90' 


■ 413 


83i55 


3.34 


jDecember. 


. ■' 6 


V 92 ■ 


■ 82 , . 


90 ■ ' 


219 


■ ■ 44.15 


7.36 ■ • 


• Januaiy 1977 


22 


• ' 326 


273 / " 


84 , ' 


782 ' 


'l46v95 


• 6:68.. 


"J ■ 

' February " , ' 


9 

) 

1 


116 


106/: 

t 

^ *. 


'(/ 


^ ■ -330 


6o:75. ; : 


■ 6.75 

* 

It 


■ , .Monthly Average^ 




. 135 ; ; 


:: i20' : : 


90, • •;• 


' 399 


; 74.70 \ 


5.38 



\ h request both for EIC documsnts and journal articles is considered two orders, one for documents and one for 
articles. ■'• / 

2C(q)iesr copies of microfiche for documentSj-.pages for articles. ' ' ■ " " . • ■ 

^ColMi averages..; . \ "'■■ ]/ 7^ ■ 



As with the search service, the duplication service's unit costs 
are deterniined largely by the volume o£ requests • Table 51 displays the 
nijrriber of orders that were received for copies of eit]|ter documents or 
articles dbixring the period from June/J.976 through February 1977. On the 
a.verage, 14 orders were received per month, coxmting orders for micro- 
fiche&and articles separately. The average order contained a request 
for 10 items, of which 9 were siq^plied for an average charge of $5.38. 
A total of 399 copies were jnade in a typical month and the charges . . v 
totalled about $75. In comparison to the search service, the dijplication 
service is a rather modest enterprise. 

To determine the actual cost pf the diplication service, sp. analysis 
of fixed and variable costs was undertaken. Because di;5)lication of micro- 
fiches requires special equipment, the costs^^^yft^r providing this service 
are costed separately from those, for duplication of articles. The latter 
service requires only a standard office copier, the cost of vfeLch is 
accounted for in the overhead. 

Table 52 reports the fixed costs per month for operating the diq^li- 
cation services. The total for duplicating microfiches is $349 per month. 



TABLE 52 FIXED COSTS PER MONTH FOR OPERATING MICROFICHE AND 

ARTTGLE DUPLICATTON SERVICES 



Budget Item . Microfiche Articles Total 



SicppZi^es and 'Printing 

Business Forms _ $ 16.67 $.16.67 .$^33.'34 

■\ Staff ■ \ ■ ' ■ : . : ; . ■ .... _ ■ - " 

Library Assistant II Cquarder-time" 

oil eacJi service at $8,250 per ; . 

year ■ including fringe benefits) 171.88 171.88 343.76 

Capital. . ... 

Microfiche Printer/Processor 

C$1,088 per year for 5 years) . 90.67 ~ — . 90.67 

Overhead^ - ' '• . - ' ' ' • . 

25§ ,of above items - 69.80 47.14 .. • 116.94 

Total Fixed Cost. per Month ' 349.02 235.69 584.71 

Total Fixed Cost per Year - 4,188.25 2,828.25 7,016.50 



ERiC 



.102 



vMle that for dijplicating articles is- $236. The difference in costs is 
accounted for*by the inclusion of the monthly cost oT the microfiche 
printer/processor in the total for the microfiche dxjplicating service. 

^_..'nie .effect . o£ the volume, of _i^uests .upon ..th 

eating raiciofiches can be seen in Table 53. The cost per copy for a 
volume 'of 100 fiches per month is- $3.59, but this drops to $.60 vdien the 
voltHne reaches 700 peY month. At the current rate of $;35 per fiche" copy, 
a subsi<fy vrauld be required until almost 1,400 copies were made per month. 
While such a level of operation is theoretically possible with the staff 
and equipment allocated for the puipose, we would estimate that in practice . 
the burden of correspondence associated with each request reduces the 
mgxinnmi number of fiches that can be copied in one montJi to about 700. 

Parallel data for a service providing copies 'of articles is presented 
in Table 54. Again, fixed costs dominate the equation, and even at the 
level of 700 copies per month, the cost per page is $.34. To break even 
\diile charcLng $»10 per copy would require a volume of almost 4,000- copies 
per month./ / 

■ The /labour involved in copying journal articles is considerable, 
exceeding that for copying microfiches since it requires that volxmies of 
journals be collected from over a wide^ a^ea, that they be transported on 
carts to the copying room, and that they be reshelved after copying 1' In 
contrast, master, copies of ERIC microfiches are^all stored in one place, 
^ and -are very easy to transport and filel Hence, xdiile a volume of 700 
or even 4^000 paper copies per month, may not appear very siibstahtial in 
termis of the numbers of pages di:5)licated,. it does represent a tremendous 
amiDunt of work in handling^ the jourria^^^ 

How do the hypothetical figures in Tables S3 and 54 conpare with 
"EISO's actual experience? IMs question can be answered by con^iaring- 
"diese two tables with Table 55.' On the average, EISO di^Jlicated 169 
microfiches and 230 pages of journal articles per month- .Given these 

. numbers,' the average costs were $2.17 per microfiche and $1.06 per page. 

However, in a peak month like January 1977, these average costs dropped 
.' to $1.33 each for microfiches and $.46 per page for journal articles. 

EISO's di:5)lication service, like its search service, has not yet. 
met its potential. For the -search service, we indicated that a reasonable 
goal was to conduct an average of 60 searches per month, which is^ about 
twice the current .number . If this goal were achieved, it is reasonable 
' to assume that the average volume of requests for duplicates would also 

™" ■ , . -lOS- ■ 



Ti\BLE 53 MODE COST M) Wm FOR MICROFIQE DUPLIQITING SERVICE 



. ' NuAer of Microfiche Di|)licated per Month 




Hxel Costs . 

lonMe Costs 

icrofiche copies • . 
(UOea.) , ' 0 

Cost per ^ontli 



5 349.02 t 349.02 



400 ' 500^ 
349.02 , f 349.02 



349.02 J 349.02 ^ 
^ 1 



i. 



\ ' , ■ ■ 

10.00 20.00' 30 J ,40.00 , SO.OO' 60,0r ' 70.00 
359.02 " 369.02 379,02 , 389,02 ' , 399.02 409;02 419.02 



' 'TtCme'"^' '^M 70.00 105.00 ■ 1«.00 IM ^ 210.00 245.00. 
' ft./it/te]p.rW« ( 349,02) ( 324.02) ( 299.02) ( 274.02) ( 249.02) ( ^Ul] { 199.02) ( 174.02) 

'. Cost per fick 
. ' Fixed Cost 
' Variable Cost 
■ 'Total Cost per Ficl 

Cost per leor 
Fixed Cost • 
Variabl** Cost 

■ Total tot per Year -4,188,25 4,30W 4,428.25 4,548.25 4,658.25 ■ 4,788.-25 ' 4,908.25 '5,028.25, 

- ■ • ' . - 



0 , 


3.45' 


■ ' 1.75' 


1.16 


^.87 ■ ^ :i 


'0 .58 


■ .50 


0- 


■ .10 


.10 
^ 1.26 


'.10 ■ ■ .] 


i .10 .: 


.10 


0 • 


3.59 


L'85 ■ 


: .97. ■' .J 


JO . .68 


., ..60 



( 



s 



1,188,25 4,188,25 , '4,188,2'5 4,188.25 , 4,188.25 , 4,188.25 4,188.25 . 4,188.25 
120.00 240.00 360.00.. 480.00 ' ' 600.00 , 720.00; . 840.00 
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DDEL OH m mm for MIOE PHDIOCOPY SERHCE?; 



Niiber .of Pages Copied per lath 



, Budget Item , 



100, ■ ■ 200 300 400 ' 500 
1 ,235-69 •1 235.69 :r' 235i9 1, 235.'^^ |- 235.,69. 



,600 ■ 700 • 



'• ' Paper fopifes . 
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■" ■ ■ ■ . * 

■•Cost pgr Mil 



• 0 •. 
235.69 



'frofit'doss) per' .tet?i ^ (' 2'35.69) 
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2(^.00 ',■ 24.00 ■ 28.00 
755.69 ■ .259.69 - 263:69 



60.00 70.00: 



iOO- :'20.00''; ■ 30.00 40.'00: ' 50.00' 
( 229.69.) ( 223.69) ■( 217.69) ( ,211. 69) "( 205.69) (.199.69) ( 193.69) 



, ■■■ ^ Fixed Cost 
' , Variable -Cost " ' 
* ' Tot'ai.-Cost per Page 

;• ■ ^. Cost pgr 
■' ' 'Fixed Cost . 
,v'.."- Variable Cost 
. Total 'Gost per Year 



2.36 


1.18, 


.79 


,3 


.04 


.04,,, 




: ■..04 


2.40 A 


1.22- , 


.83' 


.63 



.47 
.04 
: .51 



2,828.28 

0 ./ 
2,828.28 



■2,828.28 2,828.28 : 2,828.28 : 2,828.28 ,2,828.28 
-48.00 ■ 96.00 144.00 ■. 192..00 ' '; 240.00 
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2,828.28 
J . 288.00: 
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. TABLE- jSS -- VOLUME AND REVENUE .FOR DUPLICATION SERVICE' 



Month and "S^ear " 



Type o£ Duplication 



MicT'odliche' 



.-Articles 



r . . -, ;. ■ 


' " • ^ 


NundDer o£ 
Ficlie 


Revenue 


Nuniber ' o£ 
Fiche . " 


'Reveaue. 


Jime 


1976- 


; . 89 . , 


$ ; 5. 95 ' , 


■ 277 . -. 


; $ l'.40 


Jixly : ' 




. : ■. ' 8S- : ' - . 


29 . 75 


.. '103 


. . 10.-30 . 


August 




113 . 


39.55 


■ 141' 


14.10 


.^epteniber 




411 


\ 154. 35 


322 . 


32.20 


/October 


.... ■ ■ 


• , -74 ■ 


25.90 : 


234 


23.40 


NovCTiber 




■ 169 : 


■ 59.15 • 


C 244 " 


24.40 


Deceiriber 






31 15 


130; 


13.00 . 


January ^ , 


1977. 


- . -275 ■• - 


96.25 


507 


50.70 .■ 


February 




. .21?-,- 


. 38.85 - 


111 ■ ^ 


; 21.€0 


- Tbtal - 




/' ' >1,524 - . r - 


; $480^90 


■ ; 2,096 


■\$191.40 V 


■ Average V 


■ ^ ■ - . ■ ■ - --■ 


V ; ; ■ ; 169 




. ■■•■.v:;250- / :■• 


- 1 ;23;.:27^- 



*'lnclxides some "duplicates for wliich no charge was made .. Theoretical 
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doiibie. At that level of demand, with 350 microfiches, and 500 pages 

licated jjer month, the average cost per fiche would be $l\08 and the 

average cost per page would he $.47. 

• ■ In . summary, current prices for EIS0's di:5)lication service are. 

approximately one- quarter the actual cost for microfiche and one- tenth ■ • 
actu^ cost for paper copies :of j ourrial articles . Ev^ achieving the 
goal' o£ ddiibling the level of demand would only reduce, these ^ 

ratios to one-third and one- fifth actual costs, respectively.. It is our 
belief that the prices of both types of copies shotild .cover a greater .• • . 
prcTX>rtibn of the actual costs. " . ' 



Ther^^are many different schemes tJmt one might use to charge for 
copies of microficheland journal articles. .Four options in common use 
are-:" " . , ■ . " ^ . . 

1. to charge. more than EISO*s current amounts for each microfiche and 

page thali^is copied; * 

2. • to ,add a\flat charge raito the price of each seardi,^ which automatically 

entitles , the client to copies of several microfiches and journal 
articles; I'V 
3-. to 'charge a flat fee -for a- minimum order up to. a given size, with .< 
• additional material being charged for on a per- copy basis; and t ' 
, 4* to charge a fixed amount for each microfiche and each article up/ to 

a given length, with incren^ntal charges in^Josed thereafter. ' . ^ ' 
If the first option wei^ taken, the price of a microfiche mi^t 
raised to $.65, which is the price being charged for QNTERIS microfiches 
At this rate, - revenue would cover 60% of the actusCI costs for a service 

* - duplicating 350 microfiches per month.^ Paralleling this, the per-p^e 

charge dEbr photocopies might be 'raised to $ -25 per page, aerate whic±L r^^::- 
would cover slightly more than 50% of the actual costs,Vassijiidng a w 

■^^sX of 500 pages per month. ^ : • : . ' ■ ' \ \. . . /^ 

The second option of including the cost of dt^lication in with the 
• cost of the search is one used by many, search services /whose clients * are . '^V ^ 
geographically dispersed. They set iJie- pri of the search Mgh epou 
. to covej^Jthe xost. of - dijplicating several micfofiches^and airticlfes-: ^ ' / . ; 
" : Usually, the seardi; a^^ review the bibliography and select the 

' - itenis • to- be cc^ie^^^ and these are forw^ded to the cli ent .- along wltii the • 
-bibliography- This approach speeds the flow of information, and , reduces 
the'paper work substantially. If this option were adopted, a reasonable , 
fee might lie $5.00, given that the.. average, order received during 1976 
' cost the user $5.38.. For $5.00, the client might receive 1:5^ 5 f iches 
and 20 pages. An order of this size, at current rates, would cost $3.75. 
. While this mode of charging for materials might be welcomed by. clients 
outside of. Metropolitan Torraito, local users might wish to be exen?>ted 
. from, it "Since many "prefer ;t^^ either in 

their own boards or at OISE. ' . " ' 

The third bpticn is siM the second, except that the basic • 

*" fee is optional and.would be somevdiat lower ^^e^^ For this . 

^ - amomt, the iiser 'might receive- 15) to 2 microfiches pr 15 pages or.some 

• cOTibination of the two..' this p'olicy woxold elimixiate very- small orders. 

■ ■ ' •■ • . • ■ : ■ ■■ : - . ■■. ■■■ ■ - K , . ■ 



vb±ds>a^ hardly large eiiough to jiistify the cost of collecting and i3e^ 
ing'the^oney. ' . - v."- ' ' .'^ •, 

- The fourth option, vfliich ndght be ^ allied 'only to Jbumal articl.es,. . 
wculd set a. minimum fee of perhaps $2.00 for each item, no matter how ' . 
short. . Typically, the fee would pay for- dL^jlicatiori i5> tct a, limit of, 
say; 3- fichesor 20 pages/ Thereafter, a peVfiche charge' of $.35 'and a • 
per-page charge- of perha:BS $. 10 would be iii?)osed. " For exairple, an order 
of three articles of 3, 7, and 26 pages each would cost the user $5.60 
— $2 . 00 each for the first two, 'and $2 . 60 for the third. This approach , 
has the merit of charging a fixed amount for the qpst of retrieving, r 
transportirig, ' and re-filing or reshelving the fiche or volume, steps vMch 
cost the same regardless of the number of f ichfe or pages included . 

Our own preference for 'a pricing policy woiiLd be to adopt the first 
option for microfiches^ and the fourth cation for journal, articles;. 
However, additional research is necessary to determine the ■appropria:te 
level. -of the fixed charge to be set for joiimal art - 

^ * CojiGlusibri ■ :■ . 

Sfeny variables affect the efficiency with whi 

tion ^System for Ontario operates . For exan^^^e, some bibliogr^hic reta^eval 
syst^ are less expensive than others and some searches reqi^re less ^^f 
time and result in sliorter\and less expensive bibliographies than do others. 
-Two years of experience and analysis of considerable quantities^ of data . ^ 
revealed several critical factors affecting costs that must be cbnsi(!ered 
in the^ fiitufe operation of ElSOr ; ■ . i. ^ 

A number of different data bases are regularly searched by EISO. - - 
The least expensive of these is. MiC,. v±d-di, it will be "recalled:, is also ^ . 
the source . of bibliographies . whidi users rated rnost^ highly. ERIC is 
available, on two search systems regularly used by EISO, Lockheed's DIALOG 
and SDC* s ORBIT. Though the rates charged for DIALOG are less than those - 
for ORBIT, the savings of time experienced "in using the faster SDC system 
equalized the -two' systems' costs for the typical search- It api)ears, then, 
that there is .no economic .advantage ^iiat accrues to either System, though . 
advantages do exist in searching ERIC 'rather than, other data bases. 

• Ccniparison of ,the^olume-of searches conducted in each of EI^OVS'" ' 
.'two yeais shbwed that ^e average number of searches conducted per month 
had aeciined from 52 to 36 while , the average cost per. search had increased ■ 



froni $15 to $25* -The latter increase corresponded to an average increase 
in. conpiiter connect- time per search from 12 minutes (on ORBIT) to 25 
minutes (cti DIALOG) and an increase in the average number o£ .citations • 
included in a bibliography from 46 to'88. The declijie in volume was 
partly attributable to the reduction in the number -o£ free searches J 
offered to potential clients, /while the increase in the connect- time and 
lengthy of bibliographies were attributable to differences in the systems 
used ai^ in the seard^ analysts. Corresponding to th^decline in the 
nuiriber of free searches has been an increase in the number of seardies 
paid for by clients from 70% iji the first year to 86% in the .second. 

EISO^s costs were analyzed by dividing them ^ fixed and variable 
costs, and into several budget categories:- teleeoitoiunica 
materials and sillies, capi^l, and overhead. Separate estimates were 
made for the costs of the ^arch service jand the duplication service, with 
the latter being brpken down according to. the di^jlicatibrf of microfiches 
and the duplication of jdnrrial articles* 

Three costing models were developed in order to analyze the i^act 
of the amomt of .computer connect-time used per < search, the number ^ 




.citations, printed per bibliography^ and the liumber of" searches conplei 
-per month, iqjon the average cost o£\ search .and the total cost of the 
service. In these models, it was -assumed -that 15, 20, or 30 minutes of 
connect-time were used per search, and that bibliographies included 50, 
75, or ioo references respectively! At a volume of 60 searches per montH, // 
the average costs of searches/ would^*^^ to $61. If $30 weire - 

charged per ^0&rch, the deficit^per search would range dErom. $21 to; '$31,,^ ^ 
and the total deficit for a typical month frc^i $^1^^ 

The impact, of. adding a second search analyst to an existing service ^ 
.'incrbases the deficit c<|psiderably/v. Hovsrever, a/far more 

economical alternative^^ creating an altogether new search service , 
should demand become too great for one search. analyst to handle; 

Users were relatively "satisfied with ElSO's .turrent practice' of - 
charging $30. However, this "system of pritiiig brings no econbm 
-piine to .the aMocation of resources-^, such -as con^Duter connect- time, * . ; , 
sta££" time, and *nui^ of citations' printed- . Therefore, other pricing . . 
n^thbds should be considered- l^ile there are at ieast ' six. different 
options for charging, the most attractive to us is to charge separately 
for the search analyst's time, computer time, arid citations printed. 



The dL5>lication services are costed in a manner similar to the 
search service. Current cost per microfiche duplicated is estimated to _ 
be $2.17, vMle cost per journal page diiplicated is $1.06. Doubling t3ie 
volme o£ searches to 60 p'er montli would also double the volume of requests 
for duplicates, thereby reducing unit costs for di:5)licatian to $1.08 per •• 
fidie and $.47 per page. These costs still exceed the current rates of 
$.35 and $.10 respectively. Therefore, after considering four options, 
it is reconmended tiiat- the price of duplicate fiche be .raised to $.65,- 
and that a fixed charge, such as $2.00, be irnposed for each journal article 
di5)licated up to a given length with a charge per page assessed fcr addi- 
tional pages, ' , ^ ' - 

The volume of demand for both searches and diiplicates is the main 
factor determining EISQ's unit costs* The system should set a goal: of 
conducting at least 60 searches per month on the average. This in^Jlies ; 
that as many as 80 searches might be conducted m a offset 
the lower volumes at other times. Unfortunately, demand is tuned to the 
cycles of the. academic year, and therefore wide variations in demand must 
bft accommodated. EISO's two .years of experience, plus .that of others, 
suggests \he goal of 60 searAes per month is; possible The inverse 
relationship between demand and user satisfaction noted in Qiapter 3. sug- 
gests this goal must be approached with caution in order to ensure that 
the quality of EISO^s work does not suffer. 

This chapter^shoa>rs that operating even a modest -on-line bibliogra- 
phic retrieval seririce is quite expensive,, costing a jniniim^ $30,000. 
per year^ : This is a considerable cost, but it is tech^ologically 
inoperative that information services in all fields, including education, • 
adopt .on-line^, searching. Indeed, tMs technology ^is being adopted as a 
regular feature of many libraries, as the survey of Canadian on-line 
services in l±e next chapter reveals / ^ 'y- 
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Educational Resources Information Center (HOiC) indexes and microfiches 
have earned, a position as major soirrces of information for educational 
researchers and practitioners in Canada. . Their widespread use has been 
facilitated by the development of conpute'rized search services, first 
using batch, systems and more recently on-line interactive retrieval . 
methods. While it is too soon to assess, the long-term iji5>lications of 
the- greatly increased accessibility of ERIC, it may be that Canadian, 
educiators will becane hooked on ERIC and neglect Canadian sources of < • 
information if automated access to. these remains unavailable (Auster and . 
Lawton, 1974.>, ' , " ' 

- . ; / - . Use of ERIC . ' ■ • 

ERIC is available throughout Canada; Its indexes to educational journals 
(iJzirrent TTZ^iea; to Jourrials in Education or CIJE) and to; &igitive documents ^ 
CBesourdes in Education or RIE) are fomd in most libraries in faculties 
of education, teachers* colleges, ministries of education, and larger 
school boards. Collections of the. microfiche copies of documents indexed 
and abstracted in RIE are <held by 38 agencies," including at least- one in 
each province (National Institute of Education, 1975). 

' The extent to which ERIC is actually used in Canada is exceedingly 
difficult to estimate. Few statistics . are maintained in education- . ' 
libraries ^'cross the countiy and it is imlileely that detailed information 
on matters such as the frequency with vSiich printfed indexes are used can v 
even be acquired in an econoonically feasible way. In order to obtain vitat . 
data .were available^ a brief telephone survey of major libraries and infor- 
mation centres was imdertalcen in February, .1977 , (see interview questioraiai^ 
/^endix N, and organizations surveyd^^^^^ ^ . • . • 



Three miversi-^ies, one teachers*^ college, and one school board ; 
reported that they record circulation 'statistics for ERIC microfiches. 
The IM^versity of Manitoba/ estimated 8-^ ERIC fidies were used ia 1976, - 
and the Ontario Institute /for Studies in Education reported 8,400 fidies 
had been losed. Usage at OISE fluctuates during the year vdth peak usage. 
o£. over 1,000 fiches per/Wnth during the regular and summer sessions,' 
and minimum circulation/of about 550 fiches in June. Conparative statis- 
tics for the fell tem /of 1975 and faXI teim of 1976 at OISE showed an ^ 
increase in usage of 7; 6%. Cdraparative statistics' also were available for 
lifcGill Tkiversity Education Library, which reported an increase in micro- 
foim usage of 11% from 450 to 500 fiches during the last six months of : 
1976 conpared with the same period in 1975. ERIC fiches conprise appro3d.- . 
mately 90%. of the McGill microform collection. The library at the. -Nova- • 
Scotia.Teachers^ College reported a "low" level of usage for. ERIC fiches, 
though "i^^e is incteasing- due in part to a greater donand for fiches on 
interlibrary loan. Finally, the professional library of the Calgary 
Board of Education stated that only about 40 'fiches per month circulated. 
Teachers were perceived as being unaware as yet of the resource ERIC pro- 
vides. : ■ ■ ; \ 

: ^- -Taken together; these 'data cQnfirm the view that, ERIC is an inpbr- , 
tant source of information and that its tise is groi.-ing. Levels of use j 
appear to be greatest in larger universities, with professionals in the | 
■field" making the least use. One factor ^affecting level of use may be 
the availability of microfiche equipment. 

• Facilities, available for losing ERIC microfiches vary considerably, 
though most institutions have both stationary readers and reader-printers. 
Of those surveyed, only the University of British Columbia and OISE 
dtiplicate fiches and have portable readers available for loan. Several 
-libraries "did .indicate that fiches coiold be borrowed through \ interlibrary 
loan, ^ is the case in . Nova Scotia where the Nova Scotia Teachers' 
Coilege.maintains the' sole collection of ERIC microfiches in the province. 
In: sxmmaTy,' " it appears that while ERIC__f iches are available across Canada, 
obtaining them is relatively difficult for those not located in aji insti- 
tution holding the collection. Tndividioals, in this situation may be forced, 
to r.el7 on the ERIC Document. Reproduction Service ' (EDRS) in the U.S., a . 
service with vhich miny reported considerable difficulty'. Risqtiests for 
fiches, from EDRS ijsually entail six to eight week delays and confusion . 
over escact charges. It appears that opening a deposit account with EDRS . - 
may well be worth the cost for. organizations placing frequent; orders. 



. .Fiche to paper duplication o£ ERIC docimeiits is a service which is 
not provicied an ah open basis by any of the agencies surveyed. A few 
itfill print a limited number o£ pages,- for a charge from c$.ip to $.25 per 
page. EDRS remains the most economical source frou which to order ^liard 
CDpy* of ERIC documents. Problems reported in ordering hard copy £rom J 
"EDRS are similar to those reported for. ordering fiches. . ' 

ThQ time required to COTiduct manual searches of RIE and CIJE has* 
presented still another obstacle to the use of ERIC. Only graduate stu- 
dents and professional researchers "Imve had the time to devote to the 
vtask. Of course^ "the same difficulty is ericountered with other sources 
o£ informtion such as the Canadian Eduoa^izrn Indea: ((^ly or Canadiana. . 
IMs^ situation has been changing drastically ^ however, with the advent 
of^con^niterized searching of data bases. ^ 

Con^juterize^ Searching 

. . . . ■ ■ ■ ■ . ■ 

Use of computers to search bibliographic data bases began about ten years 

ago with the development of batch systems .x>3iich. ran 7*user profiled" against 

magnetic tapes - containing appropriate data bases , such, as RIE anc^ CIJE. 

The tapes themselves were a by-product of computerized processes then being 

introduced to facilitate the production of printed, indexes . Batch searching 

of data bases'quickly became a major tool for^arger libraries or con^uter 

centres offering '^current ^awareness" services,, and they are. still, used for 

that purpose at 'institutions such as the National Library of Canada. 

However, the technique has two major limitations which have iirpeded its 

-^widespread utilization. First, it is exceedingly difficult to obtain a 

satisfactory bibliography of relevant items on the first run. If terms * . . 

used in the search are too broad^ there may be too many citations ; . if they 

are too narrow, then too few may be located.^ Usually, several: runs are;^ ■ ^ 

necessary beforfe a profile is -adequately refined. The second difficulty^ 

with batch searching of bibliographic data tapes, is its expense, particu- 

-larly if requests are few and searching is extended to many data bases 

covering many years. Today, batch, searching is restri'cted to high volume 

operations wh[ere profiles are already established C^.g., a continuing 

current- awareness service) -or where precision of the search need not^be . 

too great. . Given the decreasing costs of on-line searching,, however, it \ 

is problematic i^ether or not on-line and batch Systems will, continue " 

to coexist. One university (the University'^of Saskatchewan) reported that 



their in4ous batch system had; been^idiscontinued in- fall 1976, and .that 
commercial aiid -goverranental on-line systems, would be used in the future. 

On- line interactive searching o£ bibliographic dalta bases , vfcich has 
become highly developed. only in the past three years, provides a fax more 
flexible and attractive mode of searching ERIC and other' bibliographicv . • . 
data bases . Hiese services allow exceedingly coii|)lex. search strategies 
to be- executed and -retined" on-line/ with the "numbers pf citrons . ; / ' 
located at each stage being printed as the teims are entered and-ccmbSied. 
Saiiple citations can be reviewed, their abstracts "read, and the^earch 
strategy modified if need be.' One can search by subject, by author, by 
year, and by "string" searching, of titles, abstracts, or descriptors. If 
time, is of the essence, a cOT5)lete bibliography can be printed on-line; 
"if hot, less expensive* and more readable dff- line printouts can be obtained. 

-The diversity, of aval laMe . data base is another advantage of . on-liiie 
services, available from comme^iai establishments and government agencies- 
Few coii?)uter centres could afford to maintain the more than 50 data bases 
available 'on services provided by LocKheed Information Systems CLIS} and- 
System Development Corporation CSDC). Included are. ERIC's RIE and CIJE, ^ • 
Psyaholo^ieal Abstracts, D-Lsser-tat'Lon Ahstracts-,. ExaeptioTial C^i^ld Eduear, 
tion Abstracts , and Soeiolog-icaZ- Abstracts. ■ Q^ta bases are i^-dated 
monthly and new data bases are constantly being added. LIS's recc-tly 
acquired ability to store sekrch strategies and to run these automatn.cally 
with each up-date makes it possible to offer a current awareness service ■ 
for- each search executed for^'a ^client with virtually no extra -labour and 

little extra cost- * . ' - 

On- line ^interactive search services . are -being adopted by reference 
services in university and government libraries acros^Canada at a very 
rapid rate, even at institutions which maintain batch search systems.. 
The. telephone survey • revealed that many universities have .added the . . . 
service recently or are considering- tl^e possibility' Gsee Table 56) . No • 
.dpiibt others not included in the survey also offer the . service or will 

soon do so. .... 

Tlie volume of' conputer searches of " ERIC -and "other- data bases is 
'somewhat better documented -than the use' o themselves. ;. 

'Those .institutions just beginning to offer on-line interactive searches 
. report three or four requests are received ^per week, ^^ore mature services, 

find that- 15^ to 20 clients per- week may be. expected. Depending on the . 

topic 'aiid sophistication of the clients, this level' of demand may well be 
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the maxiinuni one "a trained searcher can handle assuming that careful inter- 
viewing and planning of search strategies are undertalcen. 

Batch search services, which tend to be^^ee for internal users, . 

' report a higher level of demand. The Universit^of British Columbia - 
reported between SO and lOO^ searches are undertaken each weelc, mostly 
. for staff and students of the faculty of education. Clients of batch 
search seirvices rarely have the assistance of a trained search, analyst in 
planning tiheir search strategies. ^ '/ 

It would appear that different liorms are: developinig among those 
providing interactive as opposed to batch searching of data bases. Inter- 
active seardi services tend to operate as part of the reference sections 
of libraries, especially special iibraries, and emphasize the staff's 
ability to assist in developing good search strategies. Ssb^^, one or 
more librarians specialize in offering this service, and have ^tinctive 
titles such" as "search analyst i" search editor,"- or "conpiter librarian.": 
Batch services , while indicating a preference for this style of operation, 
in fact tend to place a greater burden on the client except where a current 
■awareness service is being' provided for a fee. Also,^ose providing 
interactive searching almost invariably charge for tiie service, whereas ^ 
most batch systems are free to a selected clientele. However, both tend 

' to charge exteijial users a higher fee than internal users. --^ would appear 
that the technolo^ . developed for interactive sea:rching is more easily -.^^ 

- adapted to the library setting and the role perceptions of referen^^^ 
librarians than is batch' searching. ; <^^ that, reference libra- 

rians are no longer providing only free services, as has been the norm 
in the past. Another is the increased enphasis on the skills of the. 
librarian' -in ''riegoti reference questions with the . client - . .< 

■ V .-■ • - ' " Impact of On- Line. Searching 

How will the availability of on-line searching affect the lose of . HUG in 
Canada? What wiif i^ ^act be" on Ca^sS^ libraries? Urrf5rtunately, 
very little data is available on feich a •loi^^- term forecast . can be based. , 
■ Oar es^erience in developing the Educational Information System for 
/Ontario^ and that of those sutveyed for this report, suggest -that provi- 
sion of on-line search services may ^ . . ; 

X. increase demand for ERIC microfiches , -* * 

^j*', increase demand for Jousnals indexed-" in CIJE, , ; 



3. inq]?ease utilization 'of interlibrary loan, 

.4. require specially trained lifc^ariaris^ to serve as search analysts, 
5. require that charges for computer ^ time , coiranimication costs, and 

o££^line printing be levied, 
.6. ■ appeal most to graduate students, professors , -and officials respon- 
sible for research, evaluation, planning, and curriculum development, 

and' • . ■ .. ■ ■ - . '. ■ ■ > .' ' ■ 

, ^ • -. . • . • • • " ■ ■ ■ 

7. foster dependence on ERIC and neglect- of printed indexes for other • 

sources.' " • •'. 

Any one of these seven points might be e3<panded in detail. Tfje - 
"acquisition of jnaterials located via -a computer -produced bibliography is 
probably 'the most immediate concern iwDSt users will face. Unfortunately, 
it" is much easier for an agency^ or library to acquire a . conputer teiminal 
and begin doing searches than to ensure that back-i:?5 materials are readily 
"available. While interlibrary loans, may be. satisfactory for a small number 
of requests, the high yolurne of requests that a successful search service 
may create could impose an undue burden. In creating EISO this problam 
was largely solved by its integration with the OISE Library which holds 
an exter^ive collection of .journals and the ERIG microfiche ; collection. 
To date, EISO has been able to fill over 99% of all valid requests for 
copies of fiches, •and over '85?o of all requests, for copies of joirmal 
articles. - • , ., / 

Trained search analys,ts able to elicit good descriptions of search , 
topics' from 'Clients and to create successful search strategies are also 
of critical in^jortahce. EISO's experience , confirmed by others,; indicates" 
. that severatl months'. «3qperience of full-time searching is heede4.,to - 
develop 'an analyst's full capability. - " Interviewing or .''negotiatinp'^skijls 
are of _particular importance r . an incorrect diagnosis will result in an 
incorrect selection of tems/ .Since a- t>^ical search reqiiires oyer, one • 
hour for interviewing the client, developing -a search strategy and running 
the . search, .it is obvious that being a search analyst requires considerable 
skill. Keying terms into a computer terminal is only a small part of the 

process. ' ' ' . V 

Charges for bibliographies produced by on-line interactive search 

systems have been, imposed by most agencies offering the. service, though 
a few provide free searches to .inenibers of thieir^ organization of arrange 
for direct biliing of- computer chkrges tp the client's organization or 
g-it. ''Typically, the charge is either. a flat rate in the $20 to $45 
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range or a sliding scale based on minutes of computer connect- time and 
number o£ citations printed off-line. Most organizations withji)atch sys- 
tems provide free searches to internal clients, and use a fee sdhedule 
similar to that described for on-line systems for external clients. Ffee ' 
schedules are listed in Table 56, 

Finally, our concern about Canadian educators developing a depen- 
d^ce on ERie and other American-produced data bases was echoed by several 
of those contacted in .the telephone survey- To date, no Canadian data 
b'ase .in the social sciences- has ,been .automated. The first such system 
developed for educatioiiaL research materials is' the- Ontario Educational ' 
Research Information System (QMTHRIS) . It. is clear that sole dependence 
on ERIC, for acquiring infoimatidn in education must be^ guarded against 
CSimimers, 1974) and that the complete automation o£ indexes such as . 
Canad-iaria and the Canadian Education' Index should be encouraged in order 
to ensure that this' dependence does not develop. 



Coriclusion 



New"^ on-line computerized 'search services are making ERIC and other major 
data bases more readily accessible throughout . Canada. Major siibscribers 
are university ^libraries, and libraries in federal and provincial ministries 
Use of ERIC, already substantial, is certain to increase in " the fcture. 
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CHAPTER 7 ••^ ■ ' 
Alternative Organizational Structures for EISO 



Who will fund and staff the Educationa.3. Information System for Qfitario 
after the Ministry of- Education research and development funds terminate 
at the end of EISO^s "diird year? Will the service remain centralized, 
or will it become a decentralized network with many nodes? These and 
other major policy ciuestions must be addressed in the near future ''if the 
momentum developed during EISO' s three years of operation is not to be 
dissipated at the end of March, 1978. 

\ " Current "Organization - 

- To date, EISO has been almost entirely sijqjported by. annual research con- ^ . 
tracts from the Ontario ■Ministry ..of Education to the Ontario Institute - 
for* Studies in Education. The impermanence of the funding and demands , 

^ ; p the :'rese.arc±i and development phases of t^ie project necessitated a- . 
teir^jorary^ organizational arrangement at OISE 'to -Carry out the tenns o£ . 
the contract. Specifically, EISO has beert admin^t^red by the Department 
of Educational- Administration at OISE under the siipervision of the Office 
of the Coordinator of. Research and Development. At the same time, the 
search service was quartered in the OISE Libraiy so that it would have 
ready access to journal and microfiche collections which were needed to 
prpvide'back-ijp. materials for the conputer- produced bibliographies genera- 
ted. by the service. " Indeed;, one jnajbr reason the EISO contract was 
awarded .to OISE was OISE's" unparalleled collection of educational resource 

.materials. '* 

The temporaTy nature of the funding was jjet/however, reflected an 
.the program of research, development, and ti'aifiajig that EISO pursued. 
From the start, it was assumed that- a decision eventually would be talcen 
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to make "the service permanent^ .To have assumed otherwise would have 
undemdned attempts to assess the viabilit>r of the service since users » 
are unlikely to come to trust a\ service -which does not have confidence 
in its own future. Research has^^Cpcused ijpon identifying the service's 
potential clientele; development iipon creating a service that is effi- 
cient aiid maintains high standards; and ;training u^^on the fam^iarization 

,. of Ontario educators with the service"^' and the provision of Educational- 
Information Consultants to Northern Ontario. The resialts of these endeav- 
dinrs provide a sound foundati'pn for building a permanent service to meet 
the information needs of Ontario educators. .* 
- The qiiestion to be answered, then, is what f brim a permanent educa- 
tional .information service should take, assuming that funds will be _ 
available. In considering this issue, we felt it best to begin by a 
reiH-ew of the objectives held for EISO, thejclientele it serves, the 
stafdE and resotnrces it requires, and the services it^provxdes. These ^ 
factors to* some extent lirnit the organizational options for the,, service : 

. that can be rea.Iistically considered. . . ; ^ .. . . • 

Ctojectives- - .. . ■ . 4 ^ 

EISG's'^^raaJor goal is to improve education in Ontario by making it easier 
vfbr educators to Iqcate obtain information for use in making decisions 
about profc:ams, :£xtrriculum, personnel, etc. EISO atteirpts to achieve this 
, goal by i^vidirfg rea'dy access to resources indexed in the various biblio- 
graphic data bases available for computerized- searching. In doing so, the 
assunption is made that relevant research, curriciilum, or other materials 
are available and can be put to use in inproving education. " Depending on 
the client in question, the utilization of the materials to improve 
Ontario education may occur . immediately , as in the -case of -a. school: admin- 
istrator, or after a lapse of time, as with a gradiiate student currently 
ini^lved in advanced studies. . - 

."Clientele, - ; ' ' 

EISO's clientele is strictly limited to Ontario educators,- though the. 

" latter is broadly defined to include not only professionals in sdiool 
boards <and the Ministry of Education, but also members of faculties of 

. education. Colleges of .Applied Arts and Technology, the Ministry of Col- 
leges and ISaiversities, etc. Even so, data pres^ted elsewhere iff this 
report show quite conclusively that EISO has two or constituencies — 
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board personnel and academic personnel , the latter including researcrhers ♦ 
and students. Each o£ these two groijps constitutes approximately 40% o£ - 
the clientele; users from government ministries, CAAT^s, etc.. malce up the 
remaining 20%. . This classification of users according to the kind of 
or^nization at^whidi they are .employed is iinportant to 'bear in mind when 
considering the dfuture organization and location of EISQ. 



' Staff . . • - .' c \ 

Staffing, an educational information service has not proven particularly 
difficult, but ,this may. in large ^rt be due to the depressed state of 
'.the j'pb market in which many well^Bj^lified individ^ are, seeking work. 
EISO required that both of. the sea9| analysts it has hired be trained 
reference-, librarians . In one case training for conputerized searching 
occurred^"^ the job, and in the other case -the individual had previous ^ 
e:xperience.: Both arrangements have proven satisfactory* • But' the ease ' 
- (or peihaps luck) with which staffing has been accomplished should not;,; 
be taken to ^suggest staff ing is. necessarily a triyiar matter. We fimly 
believe that' the .seai^ analyst ^s position is a ?ull-time job requiring^ 
a trained reference librarian. If an orgariization cannot ensure a . j| 
search analyst vdth these qualifications", we sincerely doubt it shouldr| 
cbnsider offering a computerized information service. Thp:S restriction 
pGtaces a limitation on the number and types of organiz^^tions that might 

house or be integrated into the Educational- Information Syst^a^^or^ 

... * * 
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A search analyst, hCTvever, cannot operate a search service alone. 
Clerical and secretarial staff are requirec to handle correspondence, 
fill orders, and- maintain records. Without qualified support staff, a 
service could not be effective. - ; 

Siipplementing the search service arc external Educational Inforcna- 
tion ^Consultants (EICs) , who, have proveYi :to be" reasonably effective in 
linking EISO to boards and other, agencies . ^ These EICs, wnb, are regular 
ien5>loyees, of-lihe agencies in question, learn aciditional skills to help 
: them to -help others use^^SO more effectively-. Provision of .EICs through- 
out Oritario migh.i enable ^a centralized information- system to reach into 
remote, areas, though such' a program would require a strong commitment 
. botlh from EISO itself and from each EIC^s organization, as well as con- 
- siderable funids. Achieving such commitments would not.be easy, and could 
probably be inclement ed '^nly if highly respected and influential educators 
^ave.the program their full support. 
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Resources 

r 

s 

In addition to qualified staff, EISO requires a number of other resCXxrces. 
■ Fiirst are journal §hd microfiche collections. The survey of Cahadian Com- 
puterized infomoation services described elsewhere in this report provides 
testimony to the difficulties that can arise When a service provides bib- 
liographies for which ba^-iip materials are not avail^le* Second, 
inexpensive data comiiTunication systems must be available," In practice, 
this means access to a node of either the TYMSHARE or TELENET communica-' 
tions networlcs. In Ontario, only Toronto and Ottawa are curreijtly pro- 
vided with these services. .Finally, EISO requires microfiche hardware 
such as duplicators, readers, and printers* in order for clients to make 
fiill use of fiche materials.. , 

, In summary, t^ere are three major factors to be considered when^^. 
planning EISO' s "future organizational structure: clientele, staff, and\ 
available resources (see Table 57) . All three are of critical importance, 
and failxire to consider any one' of them could, seriously affect the long- 
term viability of the Educational Inf ormatiqpK^ystem for Ontario* The . 
final fom EISO takes must efnsure that the , full range of clients are 
served, that qualified staff are employed, ^^in3"""t±tat-back-i:p materials 
are readily available. 

V . ^ , Current Trends 

In considering ElSO's future,. it is necessary to take, into account trends 
occurring in the field of - infonnation science iioMOntario and elsewhere. - 
New sources of * information become available eveiy day and^ in particular, 
the V5;e of on-line interactive systems to retrieve bibliogr^hic^informa- 
tier, spreading throughout Canada at an -incredibly rapid rate. These 
deve-.apnents may affect the options available to EISO. 

Canada ' 

Tlie survey of on-line bibliographic retrieval systems in Canada reported 
in. Chapter 6 clearly demonstrates a trend toward the universal use of on- 
line systems in academic libraries T - We feel it safe .to predict that all 
main libraries in Ontario ^s. 15 universities will have the service avail- 
able within' several years. In addition, the National Library of Canada 
and many federal and provincial government agencies have subscribed or 
will soon do so. However, this development does not necessarily mean 
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', -"BtijiEted'Level.of Iipt^^ 



Staff .' ■^Clientele. Eesources 



; 1. Ministry of Education Centralized System, . / ■ , ■ ''Medim ■ ■'"'■Mil , . . '■ ' Idim 
..■2. / Mst?ty*of Education DecentM^ed System . Low- Medim . ■ 'Jedirni" .■. 'Mm 



ro (. 



■p. Facility of Education InfoHiation Ne'twork;'' ' Lojy' - Mrni 'Low - Mum ' ■ ■ lifedium - High ' 



■■■■■ .f ■■■■ ■ ■■' ',. v.; , . 

• i . 'School Board Educational Information Neth^ork -Mum - High ■■ 'Medium . f" Low - Mm ■ 

■ ' ■■ * -V ■■■'■/■ ^ .,' . ^ 'i 

OISE Operation of EISO ■ V.v- • High \ . Mum'-High^ High 



■■ 6c ..:^Iiidependent Operation of EK^ NiJ^ ' ■ - Nil ' Nil 




ERJC ... V . 



" that greater access to bibliograpkic infbnnatim will be' prbvided to bda-T. (^ 
. citOTS oiitside: ifedversity cbraniuiiiti^ lTid66d, tiie/supfeY 

universities iii^xDse ; a surcharge o£ betiween $10 'and ,,$30 for "outside'^ • ^ . 

Also, the agencies surveyed reported that iio atten^Jt had been , made to 
recruit clients froni schoorT)oards . The -tj^o ■ exceptions to - this genersli- . ' ^ 
zation were the. Educational Information System for Ontario _and' the Infor- " 
mation/Khowledge. Research Centre, Faculty of Education, Oaiversity o£ - - 
.British CoiTjmbia, Both of these programs are somewhat similar iii philos- . 
bphy to the outward looking educational infomfiation centres that hav© - - 
developed in. the. Ifiiited" States during the past several yefe. V . 

. United States . ■ /. /. ■ ' _ '. ^ ' ^ ; •' ; ' 

Research and Information Services for Education (RISE), iii Peimsylvania 
" ■ and San Mateo Education Resources Center C^^GD . in California are two of _ 
the best known American educational information centres . Both: are financed 
largely by federal, state, and school-board :funds ; both collect and index, 
research. and curriculum materials from ^roughoiit their respective states; 
both st5)ply infomation packets, printed bibliographies, and in- depth ' . • - 
literature reviews in addition to on-line searches (see Appendices :.P and R).-: 

iJevelopment of educational information services lilce RISE and SMHIC' 
must, of course, be . considered in»terms of the . American educaTtional con- 
text. In the United States^, unlike Canada, the federal government plays: . 
' a majot role in stimulating /specif ic educational pro-ams . • It created 
• ERIC, which is the' primary educational respinrce draMn" upo^^ by EISO, SSIERC, 

■ and RISE. In addition:, it has provided funds to encourage ^the.^dissemina-. 
tion of EKEC inaterials through information centres;. " At ' the same . time , . 
state governments in the -United Staites play a relatively' minor education^ - 

' role and, with a few exceptioiis, leave most decisions ijp to local authori- 
ties. As a result, • information centres like - SMERC and^^RlSE-have developed, 
.Vnot- in state agencies, but in bo^ds of education- at- "the; -local o^^^ 

levels.::;-..-:. ■ ^- ,• - v ;. r^'''', '-.'': ,\ '■ '-^ ' . • - 

* Implications -' * ; : - " 

While the location of educational information centres in the United States 

■ is settled, the same cannot be said about Canada. : Our . tradition of strong .-. 
V ^ provincial guidance in education- woua,d suggest a major role for ministries 

of educatiog. Cindeed, .the Ontario Ministry of Education's suppprt of EISO 
O .gndsr.to confirm this view. Nevertheless, there are. indications that : : :• 

tl\lL y , * , . , J.-. ' a.' - . 

'^^^^dier agencies are interested in -the field. - • ' v - - 
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' . Two . large- boards of education in Ontario (>fetl"o Toronto and North' 
• York) have' evinted interest in sii>sc=nLbing^ to >on>-lijie bitrliographic re- 
. trieval system^ ^lih as --t^ iised by. Elisp in oT?det .to 'ii^^ to the 
/ indraimation needs o£ their own enployees and perhaps those o£ nearby , or . . 
■ ° constituent boards/ VBo%h o£ these agencies of the prerequisites ^ 
■ n^eed^ to iiomt -a^^ -^^ Also, 

the* pISE Library* has initiated its own Research Information Service for. 
; - Educatioix (gii c;n \ rj^i 1 RT?^E> ^ which is ^described fLrrther^ 

The latter service, provides bibliographic information^ and literatiiqp ; • ■ 
reviews of boofe and Canadian materials , not inc^i^eS in ERIC or other / 
> conoptiter- accessible bibliographic data.bases. To sohbs extenfT, these / ^ 
. other "initiatives in Ontario no .doubt result frcm the stiinulus ^provided v^"- 

ditario's Ivfijiistrx of Education fundi^ th;^ EISO and Qntar^ Educa- ^ : - ^ . 
tiotial Research Information System (ONTERIS) projects . However, they^^^do not 
represent^'an organized development of inforination servides^ knd 'inay in the : 
V end lessen Ontario's ability to ensure, an equitable distributioh of^informa-^ 
^ • tion resources throughout ; its educational canmunity.' . * ' 

Forms of Organizations . 

We shall ^^proach^the discussion of variqus possil>le;^x^ organise the v 

Educatfonal "Information System, for Qhtarip in the jfotqire^in • thre0 . Stagjss. , 
-y^'Ctonsiderefd. first are tiTO fundamental ^si:in5)tions i^ich we'make c<^^ 
' " ihe seiTl^ namely^ that there' should be some overall qfgantzation^ 

. th^ pi^^ educational information in CSitario', and that all regions. 7 

, of ' ditarid ^^^^^^ information. Second,^ we/review v ' - ■ 

the various prganizations and agencies whicJi; have the potential:. to play ^ % 

a role in sijqpplying -ii^ 

.these are the' Ministry of Education and it<^ Regionaa Office^ the Ontario • 
Institute; for Studies in Education and its Field Centres', the^ A'^rious : 
faculties of education, school boards, and professional organizations . / v .\ 
Each of these' organxzations is as^sessed in view of its- clientele^; staff , - - 
- and resources, as well as its likely de^ee of par^^ 

. ' tem* . Finally several alternative organizational/forms are describe . ; 

evaluated according to their ability;; to fulfill the information needs of 

Ontario educators, : . ' J 

In -our opinion, the necessity of providing some overall coordination 
gj^^" information services to educators is of the utmost ijiiportanc^ if .et^jal 



accessibility, to;" infomatdpn is to.b.e^^ur^d. -I£ larger boards and ^ : 
facnalHes of educatiori servi^&s? for their own Giientele, ignoring 

kone aoiothef^s^ekistence^ tJien redundancy Is : inevitable. . At the same^ time, 
boards in remote locations igay r^r^jnJLnadequately- served. With 'a^ reason^ ' 
able (iegree of 'central cohtrpl an^ org^i^zation, .resources can b^.iised . 
nbre e£iEiciently><^ so laiat all ma^; receive adeqxiate servi.ge. That all • 
should iSve equal^- access* to 'information may go without \saying; hovSver, 
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2;eceht,- changes ik grant, legislation -make it possiible for boards with 



l^^e assessed valxjatJLons per" pupil to raise &nds beyond ^grant ;^ 
' &ilii^ 'fbr relati^l^ rate. This featiare " , 

^incre^^s^ Ifhe likeli^ wealldiy urban boards will initiate 

new' vQQ^^uires such as informatich services that small boards >ri Ji low levels 
of we^th-^caimot a^ord.r^^ . ^ " : ^ ' 

■ ■ . The raajcfi: parties, now involved or who may soon be 'involved in 
supplying bibliographic information services to the Ontario educational 
. cciramimity inciiide the Minis tiy of Education, academic institutions, school ' 
\>oairds- and professional organizations. Any one of these can easily obtain 
a computer, terminal and subscribe to a search-, service , but few have the 
potentikl of offering a computer retrieval service with badk-iip -materials.. 

Ministry of Education '„•... ' ^ ■ - .; ' 

"Tlie^ Ministry;--^ its nine regional offices, spread' idiroti^out Ontario 
from Ihimder Bay to Ottawa, provides an. infrastructure which has the 
potential for:;;slq3porting "or beiijg a major participant in a centralized 
inf ormatioR^ system, pt maintains a central librarvr»in the Mowat Block 
> at ■ Queen'' s Parfc, Toroj^to , and ' eaidi regignai of f ic|rhas it * s own^ resoinixiie 
centre- or: professional library. The potential ojf-the regional offices 
is perhaps best, represented by the Midnorthem Regional Office in Sudbuiy' 
which has an Education Centre that is. a major resource for all of Northern 
(Dntariow However, an objective assessment of-' current clientele, staff, 
and resources of the Ministry and its regional offices suggests that it 
is^currently unable to- offer a conplete information service. ^ 

Clientele. ' ■ 'Thie clientele of .the Ministry is composed almost entirely of- . 
professional educators. Personnel in school boards throughout the province 
■have ready acee^ to Ministry offices. This makes the regional offices 
ideai'::lpcations\ fof infonnation centres serving practitioners, if ;not 
acadQiiics. However, because education officers often have SL^jervlsory 



and evs^tjativ^ responsibilities,^ research- infpimation by:> ; 

^Qiiist^y' officials may not be cons isteiJt vrith*" their pri^ liius, 

- if either the central Ministry office or regional offices became nodes in- 
an infbimation system, it would probably be pre'ferable- if an education . 
centre was crated in each office in order- to ensure the ajifofmatic^ . ' 
service' s effectiveness . - • ' 

staff. Staffing woiild provide another barrier to the Ministry's deep in- 
volvement in an information service. The staff at the Ministiy of Educa- . 
.tion are" professional educators., but rarely do they possess the ;backgr6md - 
in reference work and lih^kty^ science iSiat would be needed. - At least two- 
exceptions to' this- rule exist: one . is the I^dhortheni Education.- Centre ■ 
-iiL Sudbiiry and'the other is Queen's Parki ; these two locations could be . ' 
* Bitegmted into an ijifoimation system with relative ease w However, .&11 
; inyoivement of iie^o^ Educational Information System' for . 

■ Ontario wuld req^ to act 

as sea3fci analysts ^at- e^th site 'if -maxiniuni effectiveness were to-be achieved. 

Resoi^raes.-* As with "staf^, i^sources available at Ministiy jOff ices for 
■sv^ipor^ of s^ axe quit^ limited. , Neither the . regional' 

off ices: nor" the^ c ERIC collection: " In many 

' cases, . joiniai collections; are^ also inadequate. Thus , \f or .the MinistT^^ 
to become" centrally .involved, m^^^ ■ 
conputer retrieval , it would be necessaiy .Yor it/ to acquire back-up 
materials at considerable cost. Gonseryatively, anriml subscriptioijs-^ 
approximately" 1> 000 j ournal'^ , and ti^^^ the entire; ERIC mcro-V 

fiche collection would be rpquired^ Asstnning the average cost of the 
journals is $25 per year, 1,000 joumal. subscriptions would cost $25,000 
annually, exclusive of ordering an.d cataloguing costs, and provision of 
. retro^ective ^terials. The ERIC fiche collection costs approximately 
$2,000 per- year for vesicular copies and $4,000 per year for silver^copies 

■ C»*Lich are better for diiplication) . The ..entire fiche collection to date 
cbsts $14,528 U,S. m vesicular fi1^aid appjt>ximateT^^ $28,0Qq- in silver 
format. Again, ordering ,4Z cataloguing,' and storage costs are extra. I-f" 
appears that for an annual cost- q£ . approximately $27, OO'O^ Ce^^ of • 

- all i^t2& and overhead^ -the Ministry of Education . c^ul^d^ maintain a central 
: stbre;. of materials . to provide back-iro materials to an 

However, "amassing a coilection- ta cofe 'the^'p^^^ period ' 

covered dri ERIC tapes , might cost teil times this . amoimt. . =r V--^^:-;s-y' : 




■ ' Cdmmimic^ substantial baxrier to incor- 

• poratiaii of regional offices into' a deceh^trali zed inforinatio]\ system imless 

■ ■ only Toronto arid Ottawa have tele- 

• coninunication nodes for major telecomrnunicat ion systems lilce TYMSHAre. and 
TPi.TTN iFTl- FnytJTnatg^lyj all regional offices do have microfiche; readers 

• thiough their use would not^e" convenient fpr .members * of s<di9ol^ 

- Finally, It shcnild' be noted tiiat '^il regional offices have been supplied 

'With copies of QNTERIS microfiches, an iiaforriation resource which may be 

of growing inpDrtance in the coming years. 

^A. synoptic assessment of the. Ministry of Edix:ation.Vs current ability > 

..to support or -participate fully in either a ceijtralized or d^entralized 
' . -Educa;tionarr^ Information System ^r .Ontario is presented" iii; T^ie . 57 . ^ ' For ; 
^^a COTtralized the. >Imistry rates nj^iim for clieriteie. Csirice a 

demic users .would be e;xcluded), high for sta^Sf, and medium for resources. 

GLvenT a decentraJti zed system including all regional of fices^, the Ministry 
. . wgjtiLd be rated medium, for clientele., low ;f or staff C^^c:ept; Sudbury arid 

Toronto)-, and .mediirni'; for Resources, /'tK^ ; 

the critical^^ehortcomirig in*r the _ latter . ■ ' - . 




Faculties* of ^Educatiion . ' ; / , ^ v 

In considering the role that Ontario faculties of ejducation might play in 
'I ari" information system, one is struck^ by their tren^ terms • 

of the charafcter of their clientele, - their, staff, resources . - 

Some faculties^^Eunction only as teaciiers' colleges, ^Nrhile/ others have 
-extensive research and professional development programs. v'^However, all ^^.--^^ 

are equipped with libraries which ^coiild form t^ an infoxD^ation 

. service to a clientele broader than one composed only of the - students and 
faculty they normally serve • As well, they could draw iipon the: expertise 
of their diversities* main librarie^ are likely to be , 

offering on-line ^ervices to their miversity cdinrnunities in the near 
future. It is doubtful, however, that many of these libraries would 
consider educators in logal boards to be a major clientele and one would 
expect they would charge these clients an extra fee to cover overhead 
.cost:s. of operating the system. 

Faculty of education libraries do. not currently ■; }^ the staff that ^ . 
would be needed for coniplete liti 

such^'as;:^i^Q.;pTO However, staff could be obtained • and trairied were • 

funds^ airailable, and EISO^s research firidongs would valuable aid, 

O Ls'sist their entrance\ into this field.- Hieir. resources would also have 



to'be upgraded since only five . 6£ Ontario 'srmiversities (Queen's , Guelp^ 
Western, Ottawa, and Brock) maintain ERIC microfiche collectiohs , though 
all have microfiche readers available- Also, educational journal. cpll^c- . 
tions in many o^ the. miversity. libraries are not adequate to st?>ply ba^- 
ijp materials needed, for a con^jlete information service. -Were- a decision 
-taken, to - foster development of such services', in faculty .of . ediicatioh . 
libraries, then a more complete assessment of the resources each possesses , 
Would first liave to be completed in. order to estimate the :costs- of acqzliring 
additional. materials, needed to bring them lip .to an . adequate standard. An. • . 
overall assessment of faculties *of feducat ion suggests that: they rate , as- ; 
folloy/s: jclientele,' mediijm' since few. practising ^cMcators a^ . .. 

.staff, high; and resources , 'medium. ^: { . ■ • ■ : . • T ; ' ■'' 

School Boards . - 

Several- school boards Jaire also potential sites , for iftforajiation seryiees . ^ 
■ or service nodes The .City" o.f: Toronto, North-: Y and.Toronto r^tetrppoli- 
'tan. Separate School ^Bbaidsi'ail maintain ^^ p^ libiraries with ' com- " ; 

pifete- BE^C microfiche collections , trained staff, and a 'cj-ient^le of pro.- ; 
fessionai educators. Each have a nucleus of a journal collectioh which , v ^ 
could provide back-up materials for: many references located in. computer ;- 
searches.- But perhaps the greatest asset boards would liave in initiatmgv - 
attive . informaticm centres is their access- to board reseaix^ and adminis--; 
trative personnel, internal • information system could piobably achieve 
a high level of ijsage far more easily than could an outside agency which ., / 
must cross institutional boundaries in order to gain access to these^ per- 
sonnel- Still, -a considerable investment in staff training and. supple- 
mental back-'up materials would be necessary. ^ ' - ^_ , . -.. ; 

The Metropolitan Toronto Board of Education is another agenq^that' 
could play a. role in. an information system, a. role which might develop 
•naturally frcrni its continuing .tradxtion of research and service . to th^. six 
boarcis" (Scarborough, East. York, North York, York-, Etobicoke, and City of; 
TOTonto)! .that comprise the first tier of Metropolitan Torontp's two- tier 
system of educational governance. The Metro Board is one of few agencies 
with the trained- staff necessary for an information service, but- it lacks : 
. the- materials needed to' offer a complete; system on'' itsi own. Limiting our 
; ^ses^erit to the -major boards' mentioned, we find a ni'edium level :of access, 
ib clientele, a high Tevel of staff capabilityT- and a: moderate, level off f - " 

■ •• ■ .••',' - . : ' " .• ^ ." '■"■'' ^ : ■ .- 

resources. 



The Gfetario Teachers' Federation an<f/its constituent federations- would no * 
doiibt be ratlOTial nodes in' an informatiofi network. To date, however,' we 
have not conducted an assessment -of their preparedness for inclusiqn in . 
sad{ a system/ . -• . -^Z 

The '.Ontario Institute for Studies in Education' . * 

Finally, we consider, the p^mfianent.role the Ontario Institute for Studies^ 
in Education inight play in the Educational Information System for Ontario*^ 
It goes, without saying that OISE has the staff, clientele, and resources _ 
needed tOv Operate such a ^ sy St em^ least !^on a small scale,, given that EIS^O 

. has. pperat^. from .OISE during its first "two years. This, is not to '*say that 
OISE alorie^ coiild 6pe1:ate a iTiaxiitially effective OISE remains 

the, one provincial instit capahle^of- providing si5)po^ to all 

fecets of the Educational Inf qgmation System for Ontario . To a large 

^ extent , the size, of its role would depend , upon the m^riitude of the service 



The opportunity now exists to plan t3ie future; organization^ structure 
for providing educational infoiination vin ^Ontario:: , are three alter* - 

natives which may. be considered. The first choice ds a fully • cehtrali-zed 
systCTi which is administered by raie agency. Such a system would have , . 
only one central loqation, as is the case w^feh the Educational .Information^ 
System- for Ontario. It would have uniform policies , procedures and stan- 
dards which would be administered by . a central authority^ The second *^ 
choice is 'the cr eat i^ o £ a netispVk of infoimation centres coordijiated 
by a councill or board drawn ffom/.constituerit. meT±>ers . that would haye 
jtirisdiction over matters such -as" the provision of ,back-i:5> mate.rials and 
the allocation of funds eaimarked for^ the equalization of ^educational 
information services throughout the province.** ^The final option is the 
complete* - decCTitralizatibn, of information* services ; with each information ^ 
centre free to act ^independently of - any other No .standard pgiicies, . ^ 
procedures or f)ractices- would aj^^ly ; each--seryic;e would be fiH^ financed, 
by its hd^t organization; and each' WOTild be:, responsible for the; prpV3^sloin! - 
;6Bbac3cri^ its-clients.; . — . \ . . .; -i:^ 



' How could eaxii o£ these three options be 2ii5)lfemented? Miat would 
their inpact be on the provision' ofeducatiojial infoiiuation in: Ontario? . 

an atten5)t to answer these questions the nfext sert relate the 
roles that the various educational ^gencies in Ontario might play imder 
each of th^ise. three choices. ^ . . ^ * 

Centralized System . ' • ^ * 

the most ambitious type o£ centralized information systein would include ^ 

- a centrally located service that would be responsit>le for filling^ search 
requests and providing back~iQ5 material^ for educators throfu^out the 
province. The service would be equipped with trained search analysts 

•and computer terminals in oi^der to fili. search requests from emicators. . / 
Each board or agency "served by the one service "would also be expectgd to ;^ 
appoiiit ah Education Information,^ Consultant who would be. responsible for 
linlcing his organization with the iQcal '"educational infoinoaat ion' centre •^>-'^^ ^ 

There are perhaps- a. )ial^.dozen agencies ^ m idi^ch ^-ther -> 

have or could realistically develop, the organisational, stx^clpire and 
• .basi^;^resources necessa:fy to operate, a conpil^e informati<Mi>system lildB ^^f 
that described above, including the Ontario Ministry, of Education, .the 
Ontario Institute for Studies, iji- Education, and ;seve'rallarger school \ 

boards and -fatuities* of education. . Sack-iip materials could be siipplied 

\ ■ ' 

intone of twcf ways: the creation of a journal and microfiche /Varehouse" 

which would fill all orders for materials, liaich' the way SMERC has done 

in California, or through contracting ^^^.t^l OISE for the provision of . -^"^^ ' 

- materials, most of i^ch are cxirrently held by the OISE Library. / 

There are a number of advantages that would accrue to a centralized 
information system. First among ^these is 'expense. Only- one set of 
publicity materials, one set of procedures and one set of bacSk-iip 

- resources would be reqmred. As shown in Qiapter '5, the'cost of creating 
two distintt search services- is considerably greater than operating a 

. , 'single service with more tJian one search analyst , o The second .advantage . 
^bf . a centralized search service is its. ability to set ' and-^maintain uni- 
form standards, -thereby ensuring that educators are well served through"- 
out the province. Disadvantages of centralisation include the fact that 
the .financial burden -for .all- fixed costs would fall on a single ^agency. . 
Another difficulty that mi^t occur Tvith a -^ntiralized service 15 a. j 
of responsiveness to Ideal needs. Such ^a^f ailiHre might occur because of 

' an emphasis that would likely; be placed "on uniform standa^ds^pr xts d!LsT:ance. 
from and flack of fajjiiliarity with situations encountered .:by^^ in oiit- 




Coordinated Network 

Ideally, a codrdinated networlc- o£ information services^ would be con5)OS.ed 
of services located in various types of organizations' serving different 
■ 'tj^gs of *^ciii^Ets .in- all parts of the province These might include ■ 
faculty of education libraries serving 

tion. centres serving pra:ctising educators. ' Coordination 'of the services • . 
would be provided by a board or council -which woxildV among other ^tlmigS, \. 
.assess the accessibility of information in different regions and. formulate 
recdmnendations to its .lieinbers aimed at equalising • services . ; In ail pro- 
bability, a coordinated network would require, an outside soitrce of funds, ; 
such as the Mirii^iy of Education. • This would certainly be the .case if ~ 
its members were esqiecSted to provide services to educators in external 
organizations at the same rate- diarged _1:p' their internal clients . . It 
' might be necessary to create a system pf subsidies -to search services 
b^ed- bn the volume of searches thet cOTiduct £of clients^ 

not having their own services .' The' network would also .reqiaire a: source ; * 
of fends for providing -a central source of back-up -materials . -: ; . ■ 
"> 'Nj/irtually all edueatiohal. agekcies mig^t •■^ participate iii a . , , 

jcoordinated network of the typ®- above. In practice; however, - - 
membership might be' limited to'larger school tjoards.,, faculties educa- 
- tion, .professional organizations, OISE, ' and- the m of Education. ^ \ 

.'•Smaller agencies that would' be mable to support an adequa-de information 

service would be served by the network, and equal access to educational 
^ information throughout the province would therefore be assured. At' the 
.same time, creation of a multitude of uneconomical small services would 
•be prevented. . ^ 



'Conplete Decentralization -^^^ 

A totally "decentralized system for proj^<Hng information, to Ontario edu- 
cators woiiid consist of numerous information services scattered thrcgigh- 
put. the province in school boards, faculty of ; education libraries, and:^ . - 
offices of government and professional organizations. As we have noted, ■ 
this p'rocess Jias air eady .begun : 

^ ' Conplete decentralization does have certain advantages over a fully; 

• centralized, service . /'For example , . clients find search services in their 

' oiini or^hizat^s irbc^^^^ ^^s . This phenome- 

• , .noh itfas no.ted.> earlier , -v^/hen^ i^ discovered that EISO's clients : from . 

• ihe 'Ontario Institute for- Studies iri Ediication/had^ a more positive .y;iew ^ ■ 



V 



6£ iJie' service tJian;did those^ fr^ outside 6£ OISE, Also,.. an internal . ' 
seabrch service'^is jhore liJcely to have staff vAio are fainiliar >dth the 
.problems facfed by ^tiie. members /of- the organization./ /TVhile a centralized' 
. syrstem's linkage agents or .EICs can overcome this ^problem to some extent, 
they are not a conplete solution^ to the problem. Finally, wholly indepen- 

- dCTl: search services can exercise conplete control over their selection 
p£ clients and the type of service pipvided. In the long run, this may 

^ allow; for greater special izat 5^ and excellence* Oh the negative^ side, 
the presence of a. iarge nijiriber of searc±L services in Oiitar^ 
ii^t^^'-tt^e jnarket, and few services would have^ the volxjme of customers that 
, is needed in order to reduce the cost per search to a defensible level. 
• Indeed, since the total cost for' a riiin^ 

. woiild be greater tiian t^ designed to 

s^Tve. the same niunber xjf clienil^s, the servijceg would have to attract even 
imre clients I3ian would a single search '.service in order to equal its / ' 
cost per search. In a situatiori such as this, an. unhealtiiy conpetiton 
for clients might arise,, and staridairds could fall. • Finally, most, inde- 

' . - unable to provide STi)Stantial. amounts of bacdc- _ 

/ ■; up materials. - VTheir cli^ts would beiforced to tmm to int^rlibrary IpSi 
services in order 'to!: acquire materials.' ■ With dbarges f or iriterlibrary' • 
"loans 'now a]^ix)aGliing-$iO per book, clients w dearly for 'the 

' cost of inefficiency.- ^- - ; ^ --i ' 

-V -j^^ for organizing the Educational Infor- 

-- 'nati-OTL System foj,^ (Ontario in tli|- future. In the first one, EISQ remains ^ 

a centralized system with facilities for the dijplicati^ of -back-up . 

toterials.- In. the second option , EIS© is replacedy'by a'' 9t5«nc3.1 whose - 
■ • " ■ ■- " ■ ■ " . — -fs . _ 

. - puiposes-~.:are (1) ■ to coordinate the activities of a relatxyely small 

^^number of mediiii!i-sizefd infdimation'serjvices that are separately f indeed . 

and operated, .C2X to allocate subsidies = to the separate services , and- V - 

: (3) - to- finance a'lcentral'. ;duplica:tion service-to ens-iarb' that^back-i:5>^ . ; : ■ - 

mateidais are feadily "avaiJLable- In the" .f^l choice, EISO is replaced ( \ 

by a large- number of ■ independent information s^ervicesr, 0atih separately 

- financed and. operated. ' Each woui|.d also be responsible for pro-;^^ ' 

:-'up inaterials and setting its own staii^*rds>.prDcediires, ^d^ 

there vrould be no. assurance that all segments ; of - C^ 

community would be/ : . ^ ■ i^ '.^. ' :/ --r - ' 




In its first two years, the\EAipetionaI^In£oTmati System for Ontario 
has shown that a demand exists for* the- educational infonnation qontaiiied' 
in data bases ^^^lich can be searched by 'computer, and that this information 
can.be effectively disseminated. In at least a "fi^ cases, documented 
evidence is available 'showing tha^Bj provision of infbrniation by EISO ^ '* 

helped Ontario educators to develop and refine programs of education. 
Decisions must soon be taken concerning the provision of educational -in.- . * 
fbrmatEon :if the momentum EISO has achieved is ^'riot to be lost.' ^ 
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AccoitSng ta oiif racord*, yqw ^nductod a search through 
thtt Educational Information Syitofn for Ontario (EISO) 
(furtOB th« la« t»*o monttti ory>. As you.know. this is an 
Axparim^mal «vica. and Ji part of a renaarch project aimad 
at learning mora about tha information needs of Ontario 
aducaton, ar>d how thiBsa needs can be met. 
Could w« impc^ upon you to coppJcta the evaluation 
quattionnatc* and return it to us in the enclosed self- 
addressed and stamped envelope. The questionnaire should • 
take HO more than m frsw minutes to complete. AJl data will 
be h*ld in ftrict confidence and used only for research 

pufposei, .' • . ' - . • 

Many,^anks for your coo'peration. 

SIncaraly. ^. - \ 

Ethel Auster. Stephen B- .Ijwton 
Principal Investigators 




RS. If you requested the search on behalf of another user, 
please pass this questionnaire on to the Individual ' 
. concamed for completion. * * 



:r7 



ir . / - ■ ■ \ 
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etSd Umt BVBltMtlpit QuMlonnelro 



Th« d«t« obtltetsd from th« usor ovaluitloo questionnaire 
b* uted only for research purposes. To identify and attract 
potairdally- interested users to ElSO we must Ichow who is 
now usioQ the servic^; we must also identify and improve 
weak areas in the sedrch service. 

PleM read aadi question carefully and indicate your 
mponaa with a check niark: ST . ' 




Topic 



If you hj»we» oompleteci a previous evaluation quastlonnalra. 
plaase start at itomr-^^on 0age 7. 



7» 



r Age (^ ) Qs25 or under 

C3)n 36-45 
' (4) □ 48-55 

(5) n 56-65 

(6) □ over 65 



..:."\ 



■ "^^^^ 


2, Highest earned degree 




(DD Bachelor's 


(2)n Master's ' 




(3) D Doctorate 




(4)0 other certificate 









11 



Please Indicate your primary professional role or function 

(01) 0 Administration or Supervision 

(02) □ Teaching 

(03) □ Pupil Personnel Services 

(04) Research . ^ 

(05) □ Pield Developrnent 

(06) Q Ministry Rcgionat Off ice 

(07) D. Library Services 



(Check one only) 

(08) Q Private Consultant 

(09) O Undergraduate Student 

(10) □ M^Ed.Student 

(11) 0 Ed. D. Student 

(12) D . M.A, Student. 
(1 31 O Ph,D, Student 

(14) □ Other: — 



'4. How many years have you been, in your ojj 

(1 ) □ less than one year 

(2) □ 1 year 

(3) □ 2 years . . 

(4) 0 3 years . 



rent position? 



(5) □ 4 to 6 years 

(6) O 7 to S.years 

(7) □ 10 or more years 
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12^3 



14,1ft 



5.^ Havo you aver been #n officer of a professional 
organizatfon? ^ • * , 

. • (1) □ Y»s (2>a* No : . 



7. Hay« you writton any professional papers for 
publication or for presentation atjcon(erertces in 
.th«"liwt five years7 

(1) Q Yes * (2)D No' 





6. Are you a member of any professional organization ^ ^■ 
other than'those required tiy provincial legislatron? / 
(1) □ YcsV . - (2)D 



No 



;8, Have' you participated in an educafron&l research project 
in.the last five years? . ' - . ^ 



(DO Yes 



(2) □ No 



t8 



9. Ac^ you now studying or planning to study toward 
. . An academic degree? 



(1) □ Yes 



(2) □ Not sure 



(3) □ No 



OrganUation^t Characwiztics 



17.18 



10. ff you ar^ with a school boards please indicate 
the tovel of your primary professional positipn. 
Otherwise, check "Not applicable". 

(1) 0 Elementary grades only 
Secondary grades only 
Elementary and secondary " ~ 
Central board office 
Other: \ 



(2) D 

(3) □ 

(4) □ 

(5) n 

(6) □ 



No| applicable 



1 1 . What is the mother .tongtie of the majority of 
individuals served by your organization? 

(1) □ English 

(2) □ French . ' . 

C3) O Other:_ ■ 
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in fo rms t fOff M w da 



19^ 

39:30 

33^ 
35.3e 
37^ 



39 

^ 
41 
42 
43 
44, 
45 
46 
47 
48 
49 



12. ^Pleas9 indicate (A) the amount of time perj,week yob normaJly spend tn obtaining ii^ormaiion from each of the 
'sources listed below, and (B} how valuable, the information gained f^om each source Is to you. 

B) y^uV 

HTJ^ ^ 



Scores . 

Human jesbUrSs . '. . ; . , 
r t). Office ^tles> report/^.'. - . . 
: - C; '.Prof- OfQaniMtion*.? ^ - — 
• - d. Libraries and their holdings^ 
: journals, books^ indexes^ etc. 

«. Conferences/. 

f r Prof. Dev. Days. 

g. Academic^ prof, courses . . . . 

h. Cunjc. guides, texts 

i. ERIC materiafs 

i. Other: . 



(A) Approxifnate Vime 
Spent ^hrV/ per .week > 



LOW 

D 

^■o ■ 

□ 

□ ^ 

□ 
□ 

□ . 



""Medium- 

□ ■ 

D 

□ ■ 
□ 
□ 

□ 

(2) 



High 

□ ; 

□ 

□ 
□ 

D 
□ 

.□ 
□ 

(3V 



I'- 

a' 
a 
O ; 
□ . 
a. 
□ 



.If-' 



13. How often do you seek information for the .following? . 

Purpose ' • r ' Newer 

a. T&keep abreast in the field D 

b. Assignments, term papers, or theses D 

d Preparing or updating bibliographies C] 

d. Curriculum development . - : • - • - - Q 

e. Program improvement . .r. .t-i 

f. Preparation of speeches, reports, articles. . . . . : D 

g. Research and development projecxs 

h. Browsing ..^ D" 

i. Personnel recruitment or evaluation D 

j. Poliiey development v d 

• k. Other: : ! \ : " □ . 



^Frequency 



Sometimes 

□ 
□ 
□ 

a ■ 
a 

D 

□ 
□ 
□ 
□ 

(2) 



Ofun 
□ 

□ . 

□ ' 
O 
O 
□ 
□ 
□ 
□ 

□ : . 
{3t ■ 



Very often 
□ ■ 

□ 
□ 

D 
□ 

□ 
□ 
□ 
□ 

(4) 



V 
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£fSO S^afCh fnformstion 



BM1 



14. How did you first loam About ttia Educational - 
Information System for Ontario (ErSO) and its 
. servicas? (Check one only) 

..- .<01) D. Brochure or-f Iyer - 
-(02)^D Advenisement 
□ Prof .'bcv. Day 
(04) □ Cntssroom instruction 
^'^^^ (05) □ .-Colleagues. V^'v > ; 




(06) .□ ^Ed. Jrvfof miition Consultant 

(07) □ Library of Librarian 

(08) □ ;£lSO staff tnember 
□ Cannot recall - v 

<10) □' other: * 



15. b a microfiche reader avattable in your organization?. 

M) □ W 

(2) □ Don't know 

(3) n No 



"I6» Portable fiche 

(1) □ . Yes 

(2) 4D Don't kno' 
C3) □ No 
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SB 



Please indicate yoor satisfacttpn with the following 
. elements of EISO. Feel free to comment in the space 
provided. . 

t7* Convenience of arrangements and adequacy of 
directtons to obtain .E l SO searches. 
Comments I — : — : — '. ' 



18, Accuracy and comprehensiveness of publicity 
. materials.' " * 

Comments: - 

y ... - . ■ 

• 19. Adequacy of directions for ordering copies of " 
mareriats listed In bibliography. 
Comments: . — 1 — 



Satisfaction * 



Low 

□ 



Medium 

□ 



High 
□ 



a 
(1) 



(2) 



□ 

(3) 
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20« Bffor* using CiSO« how helpful dicf you expect IT to be? ^ 



W O -^ot very helpful 
(2> □ Somcwhet ^lelpf u1 
P) □ Very helpful . 



, Zt. Would yourecomntend iise of EISO to a coltstgue^ 

• (1). □ Yes ' ./v ' 

(2) □ Perhaps T- _ ^ 

. • (3) □ No , . V 



69.60 



22. Would you use EISO v^pln? 

(t> Yes: 
(2) □ Perhaps " 
{3> O No 



723, Do^ybu think EISO search 
permai^qinr basts? 

:''«)'□ Y« . 

t2) □ Perhaps 
(3) D 'No 



be offered on a' 



ThtMa who have oomplated previous quettionna ires, please start at thjs point. - ' 
, Othan, plaa^ continue. ^-^ ■- -v' :^** 




24. Ptease indicate the professional role for which ypu \ - 
requested thts EISO bibliography. For exampJe^ .tf the 
bibltosraphy was used -to complete a course paper for 
your M.ED. you would check "M.Ed, student"' aJthough 
your primary professional role or function ta- in 
administration. (Check one only) 

(01) CI Administration or Supervision 

(02) Q Teaching 

(03) O Pupil Personnel Services 

(04) □ Research 

(05) D Field Development *^ 

(06) O Ministry Regional Office 

(07) 0 U6rary Services 




(08) O Private Consultant 

(09) Q . Undergraduate Student 

(10) □ M.Ed. Student 

(11) □ EdJlD. Student 
D MIA, Student 
□ Ph.O- Student 

(14)\Q Other: 



J 





: .1; 



23. How^mucfe did you learn «tK>ot your topic as a 

-multofthivmrch? ' ^ . * 
^ (1) >D Nothififfor very littia 



26. Kovymuch did you learn about the Educsttonal Infor- 
; mation Syrtem for Ont^o as a ranjtt of ypuf taarch? 



X\ ■ (.1) □ Notbingor vary littta ; 



(3) □ great daal . 



27. Hpw much additional informatiori do you still desire 
* ooncarnirtQ th» topic that vyas s«ar^»«|E? 

. n) Q NothinflV very^ittlq, " , 

(2) -0 Some 

(3) □ ' Agrcatdeal 



07 



TO 
•72 

73 
74 

76 



28. How halpful was the inform^ion provided as a result of 
* your EISO. search for each of the following activities? 



K Keeping abreast of the field. 

tx Completing assignments, theses, etc , . . . . 

C Preparing or updating a bibliography 

■ d. CurricuJum development » » » 

Improving programs 

f.. Preparing a speech, article or report. 
^ UndertaUng or completing a-research or 
development project 

h. Browsing • -Ni — 

i. "Recruiting^ and/or evaluating personnel. . 
J, Developing policy. - . 



'Helpfulnftia 



k. Other: 



Low 


Medium 


Hiflh 




NA 






□ 




□ 


■ n 


□ 




□ 


□ 


□ 




□ 


□ 


□ 






□ 


□ 


■n 


□ 




□ 






□ 






□ 


□ 


□ 




n 


□ 








D 


□ 


□ 


□ 




□ 


□ 


□ 


D 




□ 


□ ~ 


Q 


□ 




□ 


0) 


. (2) 


(3)- 

f 




(4) 



S9 



A- 
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/ 

J3 



T4r 



15 



.16 



17 



18 



indicaft ^our satisfaction with the following 
elements of your E[SO. search. Feel free.to comment 
in the sp^ce provided beldw. \, ^ . 



34.»Time t«ken to dehvor the £tSp btbliograohy. 



Sjtisfactic 



Low' * Medium High . . NA 



3B. Tijw taken to deliver microfiche or pep>er copies > 
ordered from E ISO/ / 
Cotnmenw: • - : T. 



37. Tirtje taken to dctiver microfiche or paper copies 
ordered from ED RS. ^ 
^ Comments: " .- : '. l : ! 



38. Value of bibliography itself. 
Comment j: . '. 



-1* 2- 



39. Value of materjals located via E ISO bibliography. 
• Comments: .L ' , 



40. Availability of mjcrofiche/:eaderj. - " " " 
Comments: I . '. ! : — 



*□ 



□ 



□ 



< 



(2) 



(3) 



C4) 



io 



. 0 

ERIC 



00185 



■\.. 



4 



41; PtesM comment on both ttito good and bod cipmonts 
Qj^^your EISO search. Any cu«ne^ion5 you msico ' 
towmrdt improvJnQ tha torvico ara wolcomo. * <^ '■ 

' ' " ■ . ■ . ■ V- . -.^ ■■ • V 










' ■ ■ " • * « ' 










■■ - ' ■ - ■ ■ • 


■ • ^ " -■ . ■ ■ ■ ' 

. ^ * - ■ ■ . . - - » . 




• ^'-'^ - - . : . ' - . 


\ • ■ . ■ ' '. " 






' . - V -.- 'v^ :' ^ ■ 4 












Thttik you for your time and cooperBtron* 




■ ' ■■ ■ t'- ^- 

, / *• • • . 

\^ " '■ ■ . ' * 


Pleas9 rotum compteted Que^ionnairs to: 




" ■ ■ ' iff 


EISO Search Anaryst ' - 
OrSE Librarv/S278 ^ 
252 Bloor S,nTOt West 
Toronto, Ontano M5S 1V6 - ^ 

V 






.* - ■ . 










^ A . ' ^ ■ ■ ■ 
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EDUCATIONAL I NFORf-^AT ION SYSTEM FOR OriTARJO 



/ Search No. . t' t \ .g > • 



Top i c 



25rfiJ6 



27 



42 



43 



49 



Search Reaue5+ 



42. Rc'd. , . . , , 



43. ,lntvw. . , , ■, , ' 
13 



Run , rs, • , f f-'f 
. 1^ 



(07 ) Research/dgve I opment report 



45*. Purpose (01), Keep abrea5t..of field 

402)^ Asslgnrn^nt,''"terrn paoer, thesis (08) JBrowsIng 

* (03)^^ prep,, update of \ibl iograohy • (09) Personnel recruft, evaf., sup, 

• (04) Curriculum development 

■ (05) P ro>qrarrr Improvement 
(06) PreD.. speech, article, reoort 



( 10) P ol icy development 
( ^ 1 ); Other: / - 



46. Con'+'acTr (i) ' In person .. .. (2) J^hone - C3>_; .MaM 



47, Earjiest yr. rq*d. \ , - «^48. No. ref. trq'd. 

' ' 28 ... - 30 



f T t T 



49. Ffef ^ exp. , r 



34 



50. CT-h. known > ^ > 



51 . ' Price ,. , V 
40 



52. Ravmen f -C 1) . Ca sh or cheque V ^2);, Invoice C3") C ost recovery 

_Charae for search « 



■ 53.*v;ho pays (1 ) - El SO (free) !(2) PeQuestor. C?)_J)rgan. 



■ . " -^'4) . .O ther _ 

"■ ^ - " * • ■ . ' ■* . ' 

"54." QISE chaf-ge Unit ^ » ' 

44 • 

. * *<».' .■ 

-Search " . ; ^ • * ' 



55^ Ihtvw./ strat.: 'tffr.e . . % ^m ln-. 

■ ■' :\. ■ " * ^46 . - 



56. . System -( 1 ) - SDCy^ (2) Lockheed 

Sol I 57.- Data^ base (1) - ERIC (2) ^ Psych, Abs. . CSi. SSCI (4) jCEA 

^(5) Diss. Abs, . C6 ) E RIC + PA ay<£R\C ^ ECEA (8) ECEA + PA 



(9). Other: 



» -a 



58/ Connect time -p.' , ,m in.' 59. Cit. Printe?! , , ; , . 60- Cost/cil^. , , , 

.-■»■•■ " '-5.1-' \ , ■ . . ' ■ 54- ■ , : , . ^5.8- 

>• • ■ • ' • ■ • 151 - • . • .; • ■• ■ 



ERIC 



E\SO Evaluation Data-sheet 



61 



(2r 



.. ■ : ■ 

61. BiC^^nt (1) Requestor. (2) Search Analyst (3^ EIC ^) Other: 



62. Date blJSr, rc'd 



I- 



^ I ! t I L 

62 



63. Cost/hr system _j_ 
■ 68 



I » L 



71 



C 
4 



31 



Mate r i-aK Charge 
\ 

64, Pavmorl^;^ ( 1 ) Cash or cheoue ^'^^t(2)^ Invoice 



p2. \ 65. Who pays (1) EISO (2)_=!^«stor ' (3)_0rfi. (4)_pther 



68, -N El SO art 'c I ordered .j_ 



66, OlSE Charne Unit , , . 

73 

•Materia I s 

67, N EI50 fiche ordered , , , , 

•> ' 7 

69', N EISO fIche cs'rders filled by, OISE , , ,„ 

' ' ■ r ' .1'3 . ■ 

70, N'EISO fiche orders ;^f i I led by other .1 i braries , • , 

^ ■ 16 

.71, N EISO fiche orders unfilled , , , . 

19 . • . • 
72: N EISO art'cl orders fit led by OlSE , . , . 

22 

73., N EISO art'cl orders filled by other I fbraries. , , , , 



10 



J I I. 



i 4 



25 

74. N EISO art'cl orders unfilled , , , , " 

• ■ • • ■ i - 28 , . J 

75. EISO reader av'Ibl (1) Yes (^) Don't know (3) •■ nI 



76.- Price first search , , , 

, 52 



34-35 y 



77. 

\ 



-ERIC 



Please Indicate the type of organization or institution with which us.er 

is primarily associated by nlacn'ng a check C\/f) fn. the appropriate space bd'low. 

(01) preschool ^ . * / i 

(02) jiublic board . ' ' ' ■ . < 

C03) s eparate <board , . . . 

(04) private schoo^I or board ' *. . ' * -'^ . - 

(05) ' CAAT^ . - " • ; r\ \ / ^ " 
C06) Faculty of^Ed. or Teachers' CoMeqe ' , , ' ' 

(07) ^^"'verslty * . ' .. ' ' 
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EISO Evaluatj'on Hata-sheet 



. C3) 



. (08)_ 
■(09)_ 
'(10)_ 

ci2y 

/ — 

( 1 3 ) _ 

(14) _ 

(15) _ 

(16) _ 

(17) _ 

(18) _ 

(19) _ 
(^)__ 
C21 ) 

• (22) 

(23 ) _ 

(24) _ 

(25) 

(26) _ 

(27) _ 

(28) 

-(29) 



_Ministry*of Education - ' " 

_Professional Orqanization ' . 
/povernment (Not Mlnfstry of Education) 
__8u5"i ness' or ' l ndustry ' • " 

JDISE Director's Office/Assistant Director's Office 
Finance * * . . 

_Gomputina Service ^ ' 

_Pub I I cations. 
_Li brary 
R&D 



_Educationa I Administration \ 
^Applied Psychology 

_Adult Education ^ * 

JHistory & Philosophy 

_Computer Adp Meat ions/Measurement & EvaTuation 

JDurri cu I um/Modern Language Centre '1 

^Educational Plannin^q 

JSpecial Education 

^Soctoloqy in Education *^ ^ 

J^raduate Stud'tes ' * 

_Field Development ^ . . 

_0 1 her: ^ ^ v...^ ' j; 



I 7firi7'ls the organization located In 

36-37 I (01) District or District Municipal ity 

(02) County or Renional Municipality 

. \0T) ~ — M etro Jgrontd^- 

' (04) Ottawa , ^ 

. (05) London 



(06-) ^Hamilton 

(07) '/Windsor 
^ / (08) 'Sudbury 

(09) Xanada (outside Ontario) 

.(10) Outside Canada V 



79. 'Is the orqanization located in the 
38,39, Northeastern Region (tReqIon 3) of.' 

'the Province of Ontario? 



(1) Yes 



(2) 



80. What is the conrtmunlty the 
organization serves?/ 

(1 ) - M ostly- rural 

(2) _ Equally rural and urban 

(3) 1 M ostly urban 



IBS' 



'EI.SO Evaluation Data--sheet ' 

(4) 



81. Who desipned the search reguest? 

(1) Search Analyst 
i - » 

-^(2) OlSE Field Centre. EIQ 

(3) ^Fagulty of Education EIC 

(4) _ Mfnistry of Education EIC 

(5) CAAT E!C ' 

(6) Not sure 



(7) -^Other: 



5 



Sex II) Male (2>' Female 



V 
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PPENDIX C: AchniimoAration Article . 




ISO *:INFORMATION FOR ACTION 

Bod O'Neill is Superintendent of 
mtvelopn[ient for the London and 
^^ddle^x , County . Roman Clttliolic 
Separate School Board. Ruth von Fuc/is is 
(he Search -Analyst for^'^he Educational 
WMfprrnatioh Service for Ontario, based at 

Editor; I understand youVve used the 

fSO service a number of times. What 
es it do for vou? 
O'.Neill: Well, for one thing, EISO 
provide^ bifcfliographieS wit-h abstracts 
^Eat afe a' convenient and fast method of 
^Eliecting background inforroation that I 
BiecJ^pr that? one of my people nceds-rto 
l^do^gurricilum proj,e(;t/ ^ ^/ 
^];^|«>r:* Hpw* do you^ go about re- 
^EiSstinfe information'frpm EISO? 
^"^V^eill: I. just pick up the phone and 
dial; the num'ber to get the EISO search 

faly^t, and \ve^wor1< out the search 
ategy. until it feels comfortable to both 
us. This fs a? process o-f identifying the 
^^ci fit concepts or parameters of thq 
^arch.'^ — narrowing the t?eld by priori- 
Biina^'^hc aspects of the problem. Then 
PJe^^paug into the computerV system to 
searclf either the Educational) Resources 
InWmation Centre (ERIC) data base, or 

Iliebf the others that's ava'lable. suj^h as 
fyckplogjcal A bstracts. - 
Flditor: How has it been useful in your 
Job? 

H O'Neillr One of the best examples con- 
Hrns our outdoor education .prograrn, 

I ISO* The Educaiional Information SeV>^ for 
lario. is a research projcci a I H^-hs/xntVJrw 
lilute. for Studies in Kducalion. t'tfnded under 
<:«niracr>*1Ih Ihc MiniNir> of Kduc^Iion. Ontario. 
For further information, contact: • ^ 

EISO Search Analyst " r-^, 

■ OISE Library. S213 ' 
M 2^2 Bloor Street West 
V Toronto. Ont. M5S 1V6 . . 

1(416) ?23-6641 . Eict. 487 



Avhich we wanted to extent. I plugged i^to 
'EISO and ran a search on outdoor educa- 
tion programs. Our outdoor . eduction 
teacher is now scan- ning the bibliography 
— there wore 1 17 citations — to pick lip 
w hat is valuable to him. Tve already scan- 
ned it, arid wcMl take a look at it together 
in order to develop an idea of what we 
'ought to read and what we ought to do. If^ 
a* decision is made to revamp the pro- 
gram, a committee will be formed" and. 
They'll have the . background -data 
available right away. They feel com- 
fortable^with lhat — and it makes my job 
much easier since when people come to 
my office with a curriculum problem, 
they expect some kind of background in- 
formation. 

As^^an administrator, -just reading the 
abstracts on EISO bibliographies gives me 
a good feel for trends. It also gives me an 
idea of the-resources a committee mi^ht 
need, or that the implementation of apro- 
posal might require. But EISO's major- 
use for teachers, resource personnel, and 
coordinators, is for ^getting background 
informatrxDn very quickly, 
Kdilor: How quickly? 
O'Neill: Within a week or ten days. 
Kditor: Has EISO saved you naoney? 
^aii you give me a s'pecific example? 

O'Neill: I think . I' could give ^you 
.several. .On-e was a search dealing with 
teacher, evaluation. Using the abstracts 
and subject sheadings (they call them 
''descriptors") I was able to select three 
or four representative types of policies 
and guidelines, bring them together very 
quickly, look at local practices, and make " 
recommendations .-to Administrative 
Council. This saved the cost' of staff 
salaries that might otherwise have been 
spent. /■ 

Kditor:. Would other levels of 
educators find the service useful? 

O'Neill: I've shaded the concept with 
other people and find that they accept-it. 



readily* I think the heaviest user would be 
the curiculum coordinator or consultant. 
They're in staff positions and-don't have' 
line authority, so they have -to depend on 
their expertise for authority. I think that's 
good> but it's nerve-wracking fq{,them to 
have to say. "I've looked into this, but 
I'm not sure Fve ' exhausted /all the 
possibilities. "-Now. they're not going .to 
get everything that was ever written out of 
an EISO search, but at least they're abli 
*^ to identify major trends .so they can 

p^ceed with a pretty good background*. 
_ rd_li k e J o see a n E I SO .^earc h. requ est 
become a budgetHtem for coordinators' 
use. Principals might conduct searches 
too, but in curriculum matters ahey 
usually rely on coordinatqrs for the 
knowledge they' can bring.' 

One caution: I think you have to be 
, aware of the fact th^t there are some 
periodicals and, of course, some books in 
the field of education -that aren't yet in- 
cluded in the dai,a bases searched by 
EISO] 

Kajtor: I understand your Board is one 
of the first to adopt the use of the EISO 
^search service as a regular method of ob- ■ 
taining information. How did you get' ' 
started? ' % - _ 

O'Neill: Well, I had a curriculurrr' pro- 
blem andU phoned OISE and asked ^for 
some help. Someone there told me about 
OiSE — the literature hadn't been" 
distributed yet — so I phoned- the search . 
analyst, talked about the problem, and 
r'an a search. From that point on I haven't . 
- looked back in terms of using the service.- 

As for the Board, we've adopted cur-" , 
,;§^Qulum building models in the schools, 
€:ndwe have good resources and staff. So 
there's both a^demand for information 
. and the capability to use it. 

Kditor: What about access to 

documents andyarticles mentioned in the 
EISO prini-OLjif .do voU order these from 
EISO? . ^ 

O'Xeill: No, I- haven't had to. per- 
sonally. Althouse College has an ERIC 
microfiche collection in its lit)rary ;and I 
have access to original documentatiori 
there. If a person didn't have the lockl 
resourges that London and Middlesex 
h^ve, I c4n see that provision of articles 
and 'microfiches w,ould be an important 
part of the service. The only problem is - 
getting paper - copies of microfiche 
documents^. These have to' be ordered 
through ERIC documentation Service in 
the U.S.; and that's not very convenient if 
you only want a page or two. 

Kditor: Doesn't the S30 charge for an 
^ISO bibliography seem a bit high? 

O'Neill: Not if -you think in terms of 
salary ourpm to do the same job. At my 
salary, for example," the cost would b,e 
horrendous, ^ut even in terms of the cost ;* 
of paraprofessionaj staff, EISO's charge 
-is an inexpeh^e investment, especially 
when you^ See w hat your personnel can .do 
with the information provijJed. 
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APPENDIX D: Lockheed DIALOG' Information Retrieval Service 



r 



/ 



7 



ERIC 




LOCKHEECKDIALOG^ INFORMATION RETRIEVAL SERVICE 

Rate Changes -and Discount Schedules 
t ** (Effective January 1, 19?:^) cc 



^ Over the past ave years. Nsrlith jrour help, encouragement, and support. theDIAtOG ^Bervlc« 
h-tB icrown tremendously - from "3 databases in 1972 to over 50 databases today. At the ..v 
sam^-^J^. wThavc cvolve<l to our recently activated Sual IBM 360/65 system - a, large and _ 
; cxtromoly cost-orfcctiyo NystJm,. As^u consequence, wc are "^o** Pl^^t** f ^'^^-Y^'^ ^J";^ 
thcso cctmomics th rou«h proK'r.tm <fr reduced rMes tind volume discounts wWch^ will go iiUo 
- - Lrrofti rorntll-niA MK; customvrK on January- I .-l 077 . AI«o. anvppUonaL^intmum and group 
• T-ontract |,roKr:.ms arc,:.v:.LI:,».lc. which can provi.Ic adclitional .suvinp. The rollowinR-tium- 
m:iri:<(:H these ch.tnucsr.lcU.ils arc inclu<lcd on the enclosed schedule. 

' . Ho.looed tt-iteN. Chcmie:d Abst;:iels COffDKNSAXIS from ^5 to ^JT,^^^^ 

hour. UIOSIS P review:, from $G5 lo ^r, per connect hour I^^MNCT :md TELENCT 
wilt be reduced from SIO to S8 and from S8 to $5. respectively, fbr the Umted States. . 
Canada, and Mexico. ' - ■ . 

• Standard " ^0 Minimum" Discount Se^iee. -'Beginning January 1,. to addition to the 
above rate reducUons. e ach password which accumulates at least 5 hov^s of sei^ce 

• ' per month will earn a discount based on totalmonthly usage Ce . g. . S5/hr f - 9f 
- hours; up to SlS/hr for usage in excess of ^cTfeours per month). Usage on airy or aU 
. " -of our 50 databases will count in determini^:^-the discount. ^ 
' " • <^Tyt^ni ^\ Minimum MonthlVContracf. Those ^tomers who'ai-e able andjiWlUng to 

- fiarantec as little as $200/month search time ^111 .be provided a sp^^IST contract 
form' on written request. The minimum monthly contract Will aU^you to obti'in 
even greater discounts as described on the attached schedule. ^ . 

• Special Mi nimum Monthl'v Group Contract. . Group discount contacts are-available In 
even multiples of. 5 passwords . The basic contract (5 P^^.^^^^^^^s) requxres a 
SsSSmonlWy groo^ 

gun.rantccs5- 

^aUons Wc invite you to price out your search requirements (or call us - 800/227-1960 
and^l 'wiU)^ xvo predict you wrtl.find thkt DIALOG gives you more for less . 

''^-^-^^^f^r^^^ ''%^^lSr^T' 800-227-1960 

' JJ^Code 5208/201 CaUfomia 800-982-5838 

•3251 Hanover Street! nthPr 415-493-441l|>e 45412 

Palo Alto. CA 9430^ Other 346409 

Decembcyr 7, 1976 ^ r 
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diexrxlcal Abstract3 CONDENSATES (197^0-71. imd 1972-76) $4| 
BIOSIS I>review3 . / - lO 

XYMSHARE TTTMNET apcess - 8 

XEI-*ENEX access' 

,'ejnetc DIALOG password^- BiHed %°^;??^^™ts°^^omputod lnc:renientaUy. Incxeastog 




vr«,,^a -Ml^ci Per Montlx | DLscoimt per Hoiir Billed* 


0.00-4.99 
S.00-^9.99 
10.00-19j99 
20.00-39.99 
40. 00-79. 93 
. 80.00-t- 


$ 0.00 

S.OO 

95.00 ^ 
12.00 
14.00 
15.00 * 



g^^TaS^i^i^^-e^ %e^^^^ i« ^Sl^^ ou.^ accosting sys- 
tiEve m vax^ result deducted from tlie bUl. 



tem' as- sb.own» 

Discount Rate 



Hours 



0.00-4. 99 
5 • 00-9. 99 

io.c:^-ie.99 

20. 00-26. 00 
TOTAX. 



$ 0.00 
5.00 
9.00 
12.00 



Piscouxited Hours 



5 
5 

10 
6 

26 



Disc ount Applied 
5 



0.00 
25.00 
90.00 
72.00 
$187. 00 



- 010-7 nn * Tf tite 26 hours ^-ere nsed "to searcli a ^ 

eic such asSEKIC, ttieii xae 'r gj^g qo per connect hoiir- 

effeotxve cost of sUghay less • ^^axiteed monthly ^iooiuia contract, -as - 

Additional savings arc available tljrough a guargnteea my 
eho-wn on the -reverse side. ^ 

'■=5I5^^SJF^pIy o^y Ic database connect hoursXand not to telecon^unication a^^.^ 
e.nd/or charges for off -Hne prints- - . 



i 
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LOCKHEED I>IALOO®INI'ORMAXION REXRltVAI- SERVICE 



piscoTjyrrs — isgNiJvTUM guarantee "^n^ ' ^ ■ . ^ * 

This xato schedule Is available by way of separate contract to DIAXiOG users who guar- 
antee a minimum connect time paj-mcat of $200.00 a month or more.. Tho discount per 
JiavLT is determined by the amount of the guarantee and the total nuniber of hours used* 
The advantage over the standard discount is that all search hours billed each mccnth 
receive at least the discount stipulated In-td^e^cdntract. Contracts should be requested 
in writins from Customer Sexrvices. Heccuests should state guarantee level (e.g. * $ 200, 
or $400, or $800, or $1500, or $3200), and^ period (6 mon^^-oi:^ year) desired- Advanco 
payment, Is not recruired, and guarantee levels can be inc^^Tfeas^ olk>,30 days nc3tico from 
customer. . 



Hours Billed 
per ^Afonth 



0.00--4.99 
5.00-9.99 
10.00-19.99 
2p. 00-39. 99 
40.00-^9 .99 
8'0.0a4- 



$200 



"Guaranteed ^lonthlv "Minimi 



$400 



$600 



I>iscount per Hour- Bi 




1 6$l(6Qi 



3200 




9.O0 
12.00 
14.00 
TTS.OD 



EXAMPXpEiJ a 3DIAL.OG -eeaxcher signs a contract guaranteeing payment for no less t han 

$400.00 per month. T^e following month, 26 hours of connect time are 

billed against the password.^ .The discount is determined by our accot?ntlng 
system as shown, with the' result deducted from the bill.- ^ ^ . 



Hours 'Billed 


Discount Hate 


Discounted Hours 


Discount Applied 


' 0. 00^.99 
5.00-9.99 
10^0-19'.99 
20f^)0~26.00 


■ a, 3 9.00 
9.00 
9.00 
l'2.00 


. * 5 
5 
10 
6 


$ 45.00 
45.00^ 
90.00 
T2.00 


TOTi^L 




26 


^ $252.00 




to 



With the contract, the toial discount is $252-00. an Increase of $65.00 as 
the fitaiidard discoimt of $137-00-. Agaiii, if the 26 hours w,ere used to search) 
then the -total search cost would be $^00 . 00 (^6Jir x $25.00 - $252.00 = $3£ 
$4OO.Q0 with miniraura), an effective cost of slightly more than $15.00 per- connect 

batrr'.^ ■ , ' ■ r ' ' - •- 

"■*The dollar amount soecified -in the guaranteed monthly minimum is for connect time. 
. including royalties.. Charges for telecommunications and/or off^ne prints do not 
Xcotmt toward the guaranteed monthly-feinimum or the discount applied. oooq 
• **An earlier version 'of this example carried an erroneous total search cost ofv$398. 
Please note the correct version (i.e.. $400) above- ; ^ 
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CROUP PgCOUKTS - MIKT^T^JM GUARAVTEE ^ 

For those who wlah to t^o ndvantago of the discounts associated with a minimum guarantee contract but roQuira nultlDla 
paaavrot^.w© offer a group contract. In this typo of contract, all group usaKTc coimta toward the dlacountlrrtra^ctlvo 
2i"*Ki^ passwords in^the fp-oup. The i^oup administrator 1b mailed a summary invoice for proupmim^ 

, (to which the discount la applied) together ulth individual Invoices, for each passyeord. ^ ^ P memoers 

The bMle proup conalsts of 5 passwords and requires a fp-oup minl.r.um of $500 per month. Discounts «ro baaad on the 
•mountofjho gjiaranteo. and the total hours blUed. as with other VlAUOC contracts. That Is. a $500 guarantee iSth 
r 2?JJJSr**^^' ^» * Sf/v' first 49 hours of service and a $9 discount on hours 50-99 <ir used). Slmllarlr. 

^^^^?SiF^^^^^ ^ passwords gets a S9/hr discount on the Qrst 99 hours billed, and m Sl2 discount on hotin lOO- 
199. Thua. the minimum average requirement for a group contract is $100 per month per password. 

Groups can be Increased Initially or during the course of a contract in even multiples of 5 passwords (I « - . O 10 13 

' V^"J successive level of 5 passwords^requlred,. the minimum corresponding to each discount column doubles 

as do the hour ranges on which the discount is applied. Mlhimums can also be increased during the course of a contract 
to aceomnaodate Increased usage thereby deriving greater discounts. The tabic and example below clarify this contract 



Hours Billed 
per 5lonth 



S500 



52000 



Guaranteed Monthly Minimum 



$2000 



Olscount per Hour Billed 



$4000. 



58000 




^ - BASIC GROUP DISCOUICT RATES. (S PASSWORI>S) 

L EXAMPL ^tJ All American University CoUegc City. U.S.A. has 5 branch libraries and 4 reference deslcs. They 
SfS V?r?^*^*" discounts through the DIALOG system group contract for 9 passwords (Ue., r^vel-2T 6-10 passwords). 
Since AAH ^yrplca^y does from $2800-3500 v^-orth of business per month, they- guarantee a volume of S2000 bllla±>le per 
month- The applicable discount rates arc shown below. ^ - , 

During the first montJ?, 73 connect-hours arc logged for a total dollar volume of $3285 at standard rates (Including royal- 
ties). Xho appropriate discount per hour.biUcd for all connect hours up to 199 is S9C00. For 73 hours, the dlaeotint fa 
thus S657 (73 XT S9). The billable total for the month is S262S ($32^5-5657). 

PurlngDccenibcr* because of holidays, only 4S hours ofDlAIjOG searching was completed, totalling $24X6 at standard ^ 
rates- The discount appliod is still at the S5 level nnd is $432 for 48 hours of searching. This brings the total to $1984 
C524I6-$432).-* Because of the guar^inteed minifnum contract, the amount actually billed Is $2000- 

Tn J'une, a total of 233^earch hours are loc^ed'on DIALOG placing the discounts at the $9 level for the first 199 hours 
and 512 for hours 200-213. Standard search costs for the databases searched amount to a total of S8307 The discount 
for these 213 hours Is thus SlSoG (200.x 59 13 v S32), resulting in a net billing of $6i331 . Discounts, of course, will 
bo computed automatically on monthly invoices. . 

»^ - > . , 

CnOUP LEVEL 2 {6-10 PASSWORDS) S2000/MO?rrH MIXHTOM 



Hoyrs Billed 
per Month"* 


S2000 ^ ' 
Mirumurri* 


0-99 
100-199 
200-399 

Etc. 


%S 9.00%; 


- 1 2 . Qii 

> 




•^Noter These values are simply double the basic 
contract values since 9 passwords re- 
quire a Level 2 group. 



Please send for a contract form* Statin !i desired number of passwords, monthly grotip minimum, and cintract term 

(6 months, 1 year) . Or please call 500/227-1960 (S00/9S2-5838 in California) and wc xviU be pleased tb work out what Is 

appropriate for your group. . - 1™**-% 

December 1» 1976 — ^ " ' * ' 
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(iscMdytoissistbylocat^ 

jnVmlOOQuCluXl ^ ' « 

; KliptltERIC? V \ • 

^ ERIC is w Ktfonnitiofi {itte if snd (fBsenunstinj ncMork 
^theiusptooftteU^tWoniilnst^ 
ooitfcrBM pipers, cuft^^ 



Mftbedtationsars^ippfeprto^ 
set of refe^and abstr^ printed off-ljne «d {tailed to> 
the requestor, ^ 7 • 



Howl^Poi^S^bTiki? 



.jDurnti;iiKiuc&ng26^^ > 

' overJOO^refere^lCiiiihk^ v 
jrriaoeoeicninotnn. 

:H0ff4lQ$0IWp? . / • 

Byicvd)tn9 the ERIC dtis to for iniorni^ 

pfoblern Of erei of interest, you csn lesrn how otto 

iipproiched|^i$sue.ElSOprov^ 

retf ievinj references Quiddy md mexpensivdy. Coniputenzed 

SBvches of Dissertation Abstract^ 

Abstra(S,Psyd»^ 

andSxiological AtstraaareaboavaiW 



foDowsahalf'hbu'si^^ 
p(S$i&le,ltebii)liogr^ 
/days of raceipt of a seircb request 

Ihe'current charge.for a coinplete Fiterature seardii Indudio] 
consultationand prifitBd bibfog^ 

HowIX)10biainOoM 

Documents are available on niiaof^^ 
r3Stf per fiche, vfhlle paper copies le a^ 
Document ReprototkyiSerm in the United States. 
.1^ copies of jouttt^ 

• charge of 1(M per page. Ordertefor both documffits and 
artideswi1lbesenttodients# 

;>Ho«DolR«|uittiSmh? 

\ the EISO Search ReqtiKt Form on the opposite page ' 
.andmalittotheaddressbeloiiif;phonethe$eard^ > 
l416)32^1ex$.487;ormatean«pDintnM^w^^ 
'.searchanalifStattheEISOSearcfaServictOffi^ ^ 
OlSElibrafYonthesecQndfk^ ^ 

CtsrantAianMttSnioi , 

• * I , f 

If you need regular updates on your search topic, ask the se^ . 
analyst about EISO^s new current awareness service, Charges will 



particular help to those working under the pressure of 

ForpuNicaddressesaw^researchreporlsEISOwillprovehe^^^^ ' varywiththecomplixityofyoursearchprofile. 
for pbnning and decsoi^naking it may prow 

. HowDwEISOlock? 1 ^ 

A search request is submitM to the mh analyst, a speM ^ 

trained referme librarian in the OlSE 

oontiRt to conform to a I ist of subject h^^ 

computer miing of the data base/ Via a computer termi^^ 
, the$earcharalystqueriesthedatabase,Whenc^^ 

ubject headings at^ entered (e^ remedial reading AND teacher 



HovCiiCiiiRtiAfliitEtSO? • 

Besides prowfing I unful laniict, EISO n 
iooidng into the infonnition iteis of Ontario 
begreidytpptit)itedifdientsconipleteev3lu3tion(]uestionn)iFes 
or igree to be intenimied, if asked to do so. 

*Projic&fundBd undw contract iM the 

ClNf AUSV mo aUpiittLMQn, ninQIpP IIWISuJKOn. 



.Mdrtsj 



'*flione 



T3 



4 



, ImfoicsTif cheque payable to EISO is not enck)sed): 



6 



4- 



Search Topic: 
GndelneKs)' , 



Oet»leddesaip6on of topic 



!'• > • 



Reispnsforiequestingsearch (Please be specific, ' 
giving examples of flow you hope to use the information): 



Ctitionsfor relevant materials known to you, if any: 



EISO Search Analyst 
OlSE Library, S218 
252 BkMT Street West 
Toronto, Ontario M5S1V6 




APPH^ix F: EISO Order- Foim for ^ptocc^ies o£ Journal Articles. Instnictions 




Educational Infor m a ti on 
- Synam for Ontario 

OlSE i:ibrarv,S2l8 
■ 252 &loor StrtaTWatt ^ ' 

Toronto M5S1V6 
(416)^23-6641 «xt:4d7w 

Order Form for; 
Photocopies of 
Journal Articles 



Insitructions 



For each article desired, enter journal information on the grid on'the 
following page. Samples below show where information required is fisted 
on the printout of your bibliogrsphy ahd'how it should be listed on the 
order form. . . 

Sample Printout item ; '* * . 

'^IIStSoO TM5C2226 . ' ^ 
'. Craativity and Body Imaga Boundaries ^ . ^ 
Loshak. Laa X^azniicoff, Marvin . Journal 4>f Parsoniitity 
Asjassmant; 40; 1; 81-90 Fab 76 

Dascriptors: •Craativitv/. •Body Image/ 'Individual * 
Characteristics/ "Creativity Tests/ Higher Education/ Males/ 
CoJIaga Studant* ' , ^ 

f) Studies craativity as it relates to t>odv imaga, and exa9)ines * - 

the communality of sevaral craativity ipeasures. <BC) /- . . ^ 

■ ■ - ' "* ■ '/ ■' ' * * 

Sample Order Form line: <, 



Jourrtal Nanr^a 



VoL Issue N 
Mo, 't»>> P»ga(s) Data 




Comjplete address section of form orhthe following page (search number 
if given at j^op right comer of pink copy of Search Request Fdrm and 
also on the first page of the printout of your bibliography). 



Retain 3rd (pink) copy of- Order Form for your records. ; ^ 



Mail remaining copies to EISO. 



When we. reply stating cost of order, send cheque or money order payable 
to EISO. The photocopies will then be.sent to you. ^ 

— ^— — ■- — . ^ - • • ■ 



A, 
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APPENDIX G: EISO Order Form for Photocopies o£ Journal Article- 



/ 




$y9tMi for Ontario 

252 Bloor Street VBto 
Toronto M5S 1V6 ^ 
(416)923-6$41 ext.4a7 



Order Form for 
photocopies of 
journal Articles 



./SHIP TO: 
Name 



Address, 



Phone ( )_ 
Dtte 



Seerch No.. 



Vo4. issue 





























- • 




^ \ — — 






- 








^ 


























• 
















' f 




. ■ ■ ^ ■ 






• * 
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^PENDIX H: EISO Order Form for Microfiche Copies of Dosjments^ 




y . > • - 

Imtructiom ' " • 

1* Enter ED numbers in eolumrti Mow 

2. Complm addms saction at bottom left (search number U given at top righjr comer 
■ of pinfe-^opy of Search R«qu«st Form and alio on first p^ of the'printout of Vour 
biblid^aphy) ^ ' - • 

,3. Retain 3rd {pink) copy'of Order Form for-your records ^ ^ ^ 

4. Mail remaining copies to EfSO ^ jt 

5« Whan vwe reply stating cost of order, send cheque or money order payable to EISO. 
The microf ich^ copies^wilWien be tent to you. ^ 

EO Numbers ^ ED Num bers ED Numbers . 



■ J 



Educationel Information 
System for Ontario 

OISE Library. 8218 ^ 
252 GUbor Street West 
Toronto M5S 1V6 
(416) 923-6641 ext. 487 

Order Form for 
Microfiche .Copies 
of Documents 



SHIP TO: 

Nam* •« 



Address. 



Phone ( )- 



Oat*. 



Search No,. 



v 



1) EISO \ 



APPENDIX t: EISO Order Form for Paper Copy o£ ERIC ^Documents 




£0 Numbvr 



Educationall nfoiTMt ion ' 

Systam f or'Ontario 

OlSE Library. S218 , 

252 Bioor Street West 

Toronto MBS 1V6 , 

(416) 923^641 ext. 487 

Order Form 
Paper Copy of 
ERIC Documents 

From: . 

ERIC Document Reproduction Service 
^>0. Box 190. Arlington. VA 22210 
Phone. (703) 841 1212 



SHIP TO: 



Name 



Addrets 



Cott 



Phone ( 



Chelae or money order in U.S.' funds 
payable to EDRS most be enclosed. 

Date 



No. of Pagm ^ric* 
1-25 ^. ........ . SI 58 

2S-SO . .\ ^: ._^-^<-r... . . . 

5V75 rT\ S3^ 

76-100 $4.-43 

Eaeft additional 25 pages . $1.27 



Po»t»g»: 

First 60 pages SI. 00. 

Each eddttional 

60 peg** S0.50 



S Pottage 



S Total ' 



1) EDRS' 



APPENDIX J:' EISO Search AutJiorizatibn- Form 



^ EDUCATIONAL INFORMATION SYSTEM FOR ONTARIO (EISO) ^ 

V ;y Search Authorization Form . 

' . (Cost- Recovery for OIS&6taff and iStudents) 

l^eqtie$tor • r" 



%arch No» ^ ^ — — , 

Unit or Dept. 



Authorization by Administrative 
OfRcer or Unit Head 



Account to be Charged ' ^. 

(Line Item) " (Project No.) 



ate 



(Dept. No.) 



REQUESTOR COPY 
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APPH^IiC.K: ' Journal MvertisemerSf for EISO 



c 




The" Educational 
Information System for 
Ontario (EISO) 
provides computer 
generated bibliographies 
to satisfy the information 
needs of teachers, 
administrators, and 
researchers in education. 
The EISO Search Analyst 
can locate materials f^r 
you in Dissertation 
Abstracts. Educational ' 



/ 



Resources Information 
Center (ERIC) publications. 
Exceptional Child 
Education Abstracts, 
Psychological Abstracts, 
Social Sci^?ice Citation 
Index and Spbipio9ica,l 
Abstracts, and ^^ide 
' microfiche or pa peh copies 
of original materials 

To get fast, friendly, \expert 
help for your inform^ipn 
problems, iust write, V 
telephone or visit: ^ 

EISO Search Analyst 
OlSE Library, S218 
252 Bloor Street West 
Toronto,pntario, M5S 1 V6 
(416) 923-6641, Eyt. 487. 

•This reiearch prOjAcT it funded 
under contract bv Th« 
Ministry Of Education. Ontario 
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li«PENDIX L: Poster for EISO 



imeis 





id^n.fbr Instance, the time it 
s to search through indexes 
Resources in Education or . 
^syciiological Abstracts for ail the 

tfeirences about the topic you 
e working on. 



Ice 

I 



computer can do that searching 
Iess4b^ one-tenth of the tirfie 
would take you to do it manually 

I the 90% time saving worth 
^ to you or to the organization 
|x)nsoring your work? If it is, 
contact: 

^S6 Search Analyst 
ISE Library S 218 
2 Bloor Street West x 
r^-Ifo, Ontario M5S1V6 . 
EWC (416) 923-6641 €xt487 v 




tmcACCisaiON nuMtcn 

CLlAR«*«OMOUU «CC NO 
AUTMOM 

TiTLl 

oncntPTOKt 



Journal R > lf»n c» 



TIMMON&. JUCMTH . 



occn 

'ELEMi*rr*irr icmools 

'^naONNXL •CUCTlON 
rNDmouALiZIO PHOOluait 
Mf Iff OUU. OfAOUtO MtOOIUMS 



imC ACCCIDOM NUMMR 
CLIAM 

TTTLI 



»Uat.OtTiO*l OATl 

NcmnrrioMA^-iitAM 
oticnirnvi Non 



EOOIBMt 

MOJECr «0* WAMMO TEACMEK AtDtS TO 
^AOliTATI A TUTOiMAi. MAOiNOMIOOAAM wiTm * 

CMMAM O** PCnCf TUAC TIUUMIMQ »t)m PMlMAItV ^ 

KHOOk AQI f HILO^N 0« LOW SOCIOf COMOMiC 
ITATUtI Pm*L IICK>«T 

MitTOAUO 

V100 cou*rrr mc>«ooc coa» . Tfiwa HAufw. i**o 
a* 

•OUAOVAWTAOf O TOOTM 

'txawnoMkL CMKO coucatioh s 

»t"piFTXlAL WlOtOI* LlAmMWO ^ * 

PwlfaAtrr tpuCATiow ' 
*rOC»l*M OWMOCS 

'nweouu. niAOi*«a raooiiAMt 

*Tf ACMCn AlOCt 
TtrTO»»At. MOOMWfl 

OeaCHtHO tS a TfUmtMO MOOMAM to MCVAUt TXACMCM AIOCS to TuTOM •«< a AtMCO«AL MAOMM 
M*00«AM POm CMCOMIM 0» LOW SOCiOICCifOM^ STATUS mtTHK^tO** IM^AWtO Caalv 
CnaOMOOOOAOlVTM AMD OfVtLOMCNT VtSUAL MOT0« VftlCrriXMl TM*mM40 LAftOUAat ANO 
AUOrTONV OCVtLOMMNT AMD EHOTlOMAL ANO SOCIAL OCVtLOMIPiT TIIAIMir UllCTlON Tm| 
THAiMtMQ MOOAAM. IT« US| tM T>K HCOULAH SCHOOL FnOOMM AN CVALUATIQM Of Tttt PWQJtCT. 
AMO AtCOMMCNOATlONS A«t 0«CUSSCO tMC COuM< CumMiCuuiW. wiTm SUOOfSTIO TtACMtMO 
TtCMMlOgf 9. MATiniALtL ANO AmtOACMIS TQ CLASSNOOM MAMAQf MINT. « I*(CUX1C0 UM| 



7776 Use of Teacher Aides 
in RemiBdial Reading 
Partial Printout 
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Tmi5 Research pRorEcr Is Funded Under Covtract 
By The Ministry Of Eoucatioi^j. Ontta^io 
Dbel i^u^Ccr and Stephen Lavirton. Principal Investigators 
The Ontario Institute for Stodies in Education 
April 1976 



A GUIDE FOR USING THE ^ 

EDUCATIONAL INFORMATION SYSTEM i=^OR ONTARIO 



Every Day In Every WaV ^ 

<^ Information comes in all shapes and forms, jspme desirable and some unflbsirable. 
An alarm clock wakes us and a police siren stops us. Colors also give us informa- 
tion. Red is said to send bylls on ^ rampage, but it brings traffic to a halt* Numbers 
inform us as well, depending whether they're in the red or the black. 

If we lived on a deserted island we would probably miss the varieties of informa- 
tiorf we're accustomed to. Though with the difficfulty most of us have keeping up 
with the information that comes at us from all directiojfe, the prospect of a deseed 
island has its own appeal. Nonetheless* most of us ciepend on information to mak^ 
* fense of our work as well as our private lives. And part of our pkill as persons and 
professionals is learning to get the right information from the right places at the right 
times. 

'A doctor, for instance', knows how to identify and measure your vital signs in 
order to diagnose a malady. The ability to diagnose and to treat requires a good deal 
of informi^tion. The effective doctor considers the obvious signs of illness; "Appear- 
ance? appetite? elimination? body temperature? reflexes? Internal information is ob- 
tained by testing blood, urine or taking x-rays. I£ the elementary questions don't 
produce' enough information, or it's contradictory, the search goes on for more 
specific answers. All this is done to search out the kind of information hy which a 
diagnosis can be made. When the answers are available to the .right questions, the 
doctor uses the information to plan a course of treatment that corrects orxontrols 
the malady. - "^"^-^ 
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E<3acators, like Doctors 

' " Effective educators. Jike doctors, ask for information^ 

^in order to fipd out and — hopefully — apply appropri- 
ate solutions. As an .educator, your question maybe aa 
straight-forward as how many ways there are to teach 
new math, to more complicated questions about pro- 
grams for parents of, emotionally disturbed pr^ 
schoolers. ' 

For answers to questions like these, you should know 
ERIC « 

ERIC Isn't a D<>ctor 

ERIC stands for Educational Resources Information 
Center, It's a library of computerized information d^- 
ing with alJ aspects of education- 

Now if this is old-hat to -you, and all you want to 
' . ^"o*^ ^ow tor get iafprmation from ERIC, skip over to 

page .9 for directions. If ERIC is new to you. don't skip, . 
but continue reading. 1 ^ .' 

So ERIC (the Educational Resources Information 
Center)- is a computerized library. It includes, over * 
200,000 reports and articles on education. Among that 
information, material on these broad areas is available. 

. Career Educafjon . 
Urban Education 
EarJy Chiidhood Education 
^ Education Mariagement 
^ Handicapped & Gifted Children 

• Higher Education - 
, " Information Resources ' *" 

Junior CoHeges • 
Languages & Linguistics ■ 
Reading & Communication Skills - 
Rural Education & Sman Schools 
Science/Mathematics & Environmental Educatfon 
Social Studies/SociaJ Science Education 
Teacher Education " - * * 

Tests. Measurement Evaluation 



Over 2,500 new items ar^.added each mon'th to keep 
ERIC up to date. T*hcse additions are published monthly 
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• in Resources in Education (1966 on) and in Current In- 
tUx to Journals in Education (1969 on). ' 

ERIC is operated by the National Institute of Educa- 
tion in the United States. But ERIC isn't entirely Ameri. 

. can* Its computers also ixidude Canadian, educational li- 
terature and information from abroad. 

sac ^ EZSO Go Together 

Along with ERIC is EISO. EISO stands for Education- 
al Information System for Ontario. EISO, pronounced 
eye*^ by its friends, makd it possible for you in Ontar- 
io -to use this huse ERIC library- EISO was begun in 
t he Ontario Ministry of EducaUbn as a ^rvice 
--and research project. The computer terminal is in Tor- 
- onto in the library of The Ontario Institute for Studies 
in Education. - 

Who Uses EISO? 

EISO* or Educational Information System for Onur- 
been used >by teachers, principals, students, 
^perintendents, librarians. Educational Information 
Constiltants and civil servants. They're used it to obtain 
information for reports, for theses, for public addresses 
and for plannins and decision making;. 

You can use it too. ; 

If you're still not sure EISO can get the answers to 
your questions — or more likely — you don't know 
^ how to ask questions of a computer, read on. 

How Do You Ask A Computer Questions? 

So you think EISO can provide the kind of help you 
could use. But how do you send questions to a compu- 
ter? 

There's a special librarian at EliSO to help you get the' 
information you need. Because the library is computer-, 
ized, that person is calTed a Search Analyst, But don't let 
that scare you. You can write or phone or drop in to see 
the Search Analyst at EISO for assistance even if this is 
the first time you've used the service. There are also 
Educational Information Consultants in parts of Ontar- 
io ivho know how the service works aind are happy to 
help you, But if youVe on your own, this is your best - 
Suide^oEISO. 



Yoi»-'re probably familiar with the way card files in 
the library help you find printed material. You know 
abou^-Jooking up information by author, title, and sub- 
ject. The equivalent of the card file for usins ERIC is^ 

*^special dictionary called the Thesaurus of ERIC Descrip^ 
tors. Now if pronouncing Thesaurus makes you lisp^_ 

"call it "the Book of ERIC E>escriptors:i'It lists icey words- 
related to all the educational literjaturc found in ERIC. 
The descriptors are in aFphabetical order, and ea^ des- 
criptor is followed by a cluster of other terms t6 help 
you see if the computef'^interpretation of the word 
matches your own. The clusters in dude. Broader Terms 
(BT), Narrower Terms (NT). Related Terms (RT) and 
what, the main word is used for (UF). The date the term 
was first [added to ERIC is also indicated. Here are two 
examples:" * . - 



REMEOFAL READING Jul. 1966 
NT Corrective Reading *^ 
BT Rea^g 

Remedial Courses 
RT Reaching Centers : - ■ 

Remedial Instruction 

Remedial Reading Clinics 

Remedial Reading Programs 

Retarded Readers " . 

TEACHEF^AiDES JuM966 

UF Teacher Assistants 

NT Bilinguai Teacher Aides 

BT Paraprofessional School Personnel 

RT Differentiated Staffs 

Programed Tutoring 

School Aides 

Scrence Teachers 

Teachers - - 

Voiurhteers- » 

There are other sections in the Thesaurus to help you 
pick out appropriate descriptors. The Rotated Descrip* 
tor Oisplay splits multi-word descriptors' such as Stu* 
dent-Teacher Ratio into single words and arranses them 
alphabetically. 
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The Search Analyst at Sifeo uses ^he Thesaurus of 
ERIC Descriptors. ElSOs Educational Informatitm 
Consultants fia^ them too. You con ask the EISO 
. Search Analyst where you can purchase one for- your 
professional library. " 

' EISO Search Analyst / 

QlSELibrary,Ro6m.S2ia — . 

2S2 Bloor Street West 
Toronto. Ontario M5S iy6 
(416) 923-6641 ext. 487 

Impertinent qu5?stions get innpcrtinent answers. That's 
why it's important to write down^your question and re- 
lated personal or geographical names, test names, spec- 
ial terms, spons^ng bodies and any other details that 
can be used by the"computer, 

TTicn get in touch with the Search Analyst. Together, 
you can put your question in aiorm ERIC will under- 
stand. 

A Search Warrant 

Having though^ about yxjur question, and having 
chosen some key words, you're ready to request a 
search. The Request Forms are sinrtjlar to the following j 
sample-. You may obtain them from the EISO office, 
from the Educational Information Consultants, or this 
sample may be copied. Even a letter will do* 

The Search Analyst 

The title. Search Analyst, refers to the person who 
conducts the actual search on the computer terminal, 
and isn't to be confused with the not^ doctor from 
Vienna. lAdept search analysts are worth their weight in 
silver, and the one at EISO is of the sterling kind. 
* Ideally, you'd sit down with'iier todiscites your ques- 
tion and be present as the conaputcr responds. The next 
best thing is for you and the Search Analyst to have a 
phone conversation before the search begins^ especially 
if this is the first time you've used the service. This can 
be important because putting your question to the com- 
puter is a skill of its own and the Search Analyst per- ' 
forms a sort of bilingual feat enabling you and^he com- 
puter to comn^unicatc, Jf she has a clear understanding 
•of the kind of inforrnation you do need, and x>f what 
. you do not need, and of howyou plan t<Tuse it, then she 
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EISO SEARCH REQUEST FORM 

EDUCATIONAL INFORMATION SYSTEM FOR ONTARIO 



1) -Name: 



Address: 



2) ^invoice (if payment i§ not enclosed): 



Phone: ( )_ 



2f) Search Topic:. Grade level{s) — _ 
■ Detailed description of topic — 



Year(s) to be searched — 



4) Reasons for requesting search (Please be specific, giving examples of how you hope to use the 
information). — ; ^ . " ■ ■ 



5) Citations for relevant materials known to you, if any — 



It 



Please mail completed search application to 

. EtSO Search Analyst 
OrSE Library. Room S 218 
252 Bloor Street West 
Toronto, Ontario M5S1V6 
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«n w her inscnuiey^ on your behalf, to set exactly 
whatyou want/ - ' 

* ' o ^ » . _ • 

The^ariswei- willibe imhe form of a "orjourn^r ar- " 
eiclea and dociitnpAta with their abstracts. To a question 
yoxi could get a list of 11^ re f erence s which could well be 
1CX3 more than you want'. That's why the computer res- 
ponds at first only with the number of references. When 
the number of references looks manageable, the compu- 
ter is then asked for «ctual titles and details. 

How Long Does It Taker ■ > 

If you've given sozn# thought to your question before 
you contact the Search Analyst, the actual search on the 
computer wiU probably take less than 15 minutes. The 
computer gives its answers back on what's called a 
printout. The printout jwill be sent to you as quickly as 
the mails allow. You should allow a week. 

How Much Oocs It Cost? 

The cost of a. search, in the S30-$40 range^ pays for 
-yotir conversation' with the Search Analyst, the actual 
computer time and the final bibliography. This rate may 
change, so confirm it with the Search Analyst. If you 
ftsked three distinct questions, that would constitute 
three sep^r^ie searches and you would be charged ac- 
cordingly. You may be invoiced. 

Asain, Whaf 5 Yotir Qnestioir? ^ 

It's easy to restrict your question in certain ways 5t> 
you don't get swamped witi^ a bibliography as long as 
your arm. 

Let's say you want EISO to obtain for you informa- 
tion on The Use of Teacher Aides in Remedial Reading. 
Teach^ aides is an obvious descriptor. That's typed 
into the terminal by the Sea?eh Analyst and the compu- 
ter responds with the number of references to that* Say 
there are aSX references to it. Then you choose remedial 
reading prosram^ as a descriptor and, that's given to^the 



computer. The reply comes back that tKrre are 509 ref- 
erences. You can tell immediately that, for your purpos- 
es, both these lists are too long! And besides, you want 
them connected. By asking the computer to link teacher 
„ aides remcdiaL^ding 

would mdicate there are 11 references to the combined 
topic. You could then request the eleven references with 
tneir abstracts. * , 

The kind of reasoning yoO've just performed is called 
Boolean logic. We use it every day. but wc rarely give it 
such a fancy^abd. The -mind* of the computer works by 
Boolean logic, and it means the computer is able to link 
mrormation in. three ways: " 

' 1) AND • 

2) OR 
. 3) NOT 

■Reconsider your hypothetical question abou t The Use of 
Teacher Aides in Remedial Reading. First you asked for 
all the references to teacher aides. There -were 851 of 
them . Then you asked for references to remedial reading 
programs and were told there were 509 of them. Because 
It was important that you get the relation of teacher 
remedial reading programs, the Boolean link 
AND was added. You-*vere told there were 11 references 
to the combined topics. 

Butsuppose you had hoped for inore than 11 referen- 
ces. Then the Boolean link OR can be used to make the 
list lon^r by adding a qualifying dcs<:riptor such as 
paraprofessional school personnel in order to includere* - 
levant references hot indexed under teflcfc^awfes. 

Or supposing your interest is only in the eleipentary 
*^rl^^ 'cvel, the computer can f>e asked tq exclude all s 
references to secondary schools. The Boolean link NOT 
can be «scd to exclude irrelevant ref er e n ces^ * 
- This ability of the computer to link and exclude mfor- 
mation, at the press of a button, surpasses the versatility " 
and alacrity of the most dazzling librarian you're ever 
likely to meet. 

Here's a graphic explanation of the Boolean way of • 
linking information : 





Teacher Aides 
n = 851 



Rerr>edial Reading 
n = 509 



Teacher Aides AT^O Remedial Tteading 
n 11 - 



- Notu^ the 851 references >to teacher aides include 11 
references that, also deal with remedial reading, and 840 
that do not. Conversely, the 509 citations for remedial 
reading include the same 11 references that have b^jth 



. terms as descriptors, and 4Q8 that are indexed onl^ 
under the one term, remedial reading. 

The Computer's Reply ^ 

The Computer's seairch~r6flrnaterial " to" your question " 
takes only a few minute*.. The replies come first in the 
number of references. When you — or the Search Ana- 
lyst on your behalf — are satisfied that the number of 
references looks manageable, the computer is ^sked to 
give titles. Those references with their abstracts form a 
bibliography printed out by the computer. The printout 
plus an explanation is mailed to you, A partial printout 
is shown on the next pag«- 

So I Have A Bibliography 

So you have a bibliography printed out by the com- 
puter' You still need lo get hold of theactual articles and 
documents you want from among that list. The titles 
you choose m*ry be articles frorft educational journals. • 
monographs or papers read at ^Tonfercnces. The printout 
ihdicates which form the material is in. If the title is pre- 
. ceded by EJ and a number,. for instance EJ 090 471. you 
know it's a journal article. If the title begins with EO and 
a number, that signifies a report or document. The ED is 
derived from educational document whereas EJ refers to 
educational journal. But an explanation accompanying 
your printout will explain all that to you. Your nearest 
university or publiciibrary may have the material you 
want. If not, it may be ordered in the following for- 
mats: - 

1) microfiche of documents ' • 

2.) photo copies of journal articles 

■ 3) papercopies of -documents made from microfiche 

Before ordering, ask yourself these questions': = 

1) Do 1 have access to a microfiche reader? " ^ 

2) *How quickly do I need the material? ^ , 

3) How do I plan to use it? 
;4> How much does it cost? - 
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EmC ACCESSION NUMBER 
CLEAmNOHOUS^ACC. NO. 

..„AUTMOa : 

. TTTUE 

PUB UCATfON DATE 

SOURCE 

OeSCRlPTOftS 
» OESCnrPTOftS ^ 

OCSC€MPTOft5 < 

DESCRIPTOR - . 

DESCRIPTORS 

OESCRTPTORS 
DESCRIPTORS 



The Use of Teacher Aides in Remedial Reading 

Partial Printout 
Journal Refenenco 



C-K»0471 

TiUmONS. JUOfTH 

USiNQ PARAPPOPESSiONALS IN^ThlE ELEMENTARY 
SCHOOL REAOfNG PROGRAM 
DEC 73 

KAPPA DELTA PI RECORD: 10: 2: 57 
'ELEMENTARV SCHOOLS 

-PARAPROFE5SIONAL SCHOOL PERSONNEL 

•TEACHEFT AIDES 
••READrNG PROGRAMS 

•PERSONNEL SELECTION 
JNDlV10UAt4ZED PROGRAMS 
.REMEOlAl, READING PROGRAMS 



ERIC ACCESSION NUMBER 
CLCARrNGHOUSe ACC NO. 
TITLE ' 



• PUeUCATION DATE 
JSSUC - 
INSTmmONAI. NAME 
EDRS PRICE 
DESCRIPTtve NOTE 
DESCRIPTORS 
DESCRIPTORS 
DESCRIPTORS . 
DESCRIPTORS 
DESCRIPTORS 
DESCRIPTORS 
DESCRIPTORS 
DESCRIPTORS 
ABSTRACT. - 



Document Reforance •* " 

^ ■ ^ » 

EC005441 

PROJECT FOR PREPARING TEACHER AIDES TO 

FACILITATE A TUTORIAL READING PROGRAM WITK 
^ EMPHASIS ON PERCEPTUAL TRAINING FOR PRIMARY «r4 ^ 

SCHOOL AGE CHILDREN OF LOW SOCIOECONOMIC ' ^ 

STATUS. FINAL REPORT. ' : 

^EB 7X3 ' . ' - ^ . . , 

. RIE70AUG. V ^ 

VIGO COUNTY SCHOOL CORP. TERRE HAUTE, IND ' ^ * 

.EDRS PRICE MF$0.65 HCS3.29 

-23P. ^ . 

-OrSAOVANTAGEO YOUTH 

"■EXCEPTIONAL CHILD EDUCATION 

PERCEPTUAL MOTOR LEARNING 
PRIMARY EDUCATION 
PROGRAM GUIDES . - ' 
-REMEDIAL READING PROGRAMS 
•TOCHER AIDES 8 ■ 

'TUTORIAL PROGRAMS * 
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Ordeiins Microfiches 

The word microfiche Is pronounced 'micro-fe«sh' In 
case you ve never used a microfiche, it's a celluloid card 
about 4 by 6 inche3 in size on which a great deaJ of 
printed copy appears in miniature. When placed in a 
machine called a microfiche reader, the condensed copy 

iscniar^BCd-on^ «cre« for easy-reading:- An a veragere^" 

^^r^ condensed on 1 to 3 of these <?ard3 since one 
^rd mchidcs up to 96 pages of text. Ordering micro- 
nenes. o^ course/ assumes you have access to a micro- 
2 w ^^"Ia-X?^ library may have one. Each micro- 
fiche from EISO costs 35c, Based on the information in 
your printout, order microfiches from : 

EISO Search Service ^. , 
OISE Library, Room S 215 
252 Bloor Street West ^ 
Toronto, Ontario M5S 1V6 
(416) 923-6641 ext. 437 

The microfiches will come to you promptly in the mail. 

Qrdcrixts Pltotocoples 

Photocopies oB journal articles may be orSS^ at a ' 
price of 10c per page from EISO. - . 

Ord^rin^ Paper Copies of Document 

^ copies, sometimes called hard copies, are dis- 

ttnct from ordinary photocopies in that they're made 
trom microfiche originals. This service takes more time 
, and costs more than ordering microfiches from EISO 
It » offered by EDRS in the United States. Their address 

ERIC EJocument Reproduction Service 
- P.O. Box 190 

-! Arlington. Virginia 22210 

(703) 841-1212 

The cost must be.pre-paid in American fund:*. 



^JJ^^^^of^l information you asked for. It's now in your 

Complaint CTepartznent 

EISO (that's Educational Information System for 
Ontario) can do remarkable things for you. It can ob* 
tarn for you valuable and hard-to-find information in«-"" 
pensively and at impressive speeds. It cannot, however 
answer all your educational questions. l,ut then yoil 
dtdn t really expect it would. Vasue questicffls inevitably 
get vague ahswers. If your question isn't the sort ERIC 
can answer, you 1! be told so. There may be other ways 
of answering your question and the people at EISO are 
committed tO'hclping you. 

If you have a complaint, don't grumble about it to 
yourself set in touch with the Search Analyst about it- 
The buck stops there. 

EISO Search Analyst 
OISE Library. Room S 218 
2f$2 Bloor Street West 
. . Toronto. Ontacio M5S 1V6 

(416) 923-6641 ext. 467 



It's In Yotxr Hands 

_ The material comes to you in the form you requested* 
EISO and ERIC have done their p^rt in obtaining the 



STEPS IN COISpUCTlNC A SEARCH 

1 , Write out your question. 

3, CHOOSE.DESCFUPTORSANO KEY WORDS 

5. RECEIVE PRINTOUT WITH REFERENCES AND 
ABSTRACTS-- - ' : > 

^ P.^?S? ARTICLES AND DOCUMENTS YOU 
WANT, 

^' U^Kl INFORMATION^ GOOD^ 



A list of explan^hons of abstruse, arcane, dialectal and technical terms known as a 

pLOSSARY 

Abstract 

- an informative, short summary of the subject and contents of a reference. 

"^"Access pptnt*""^ ""I " . ^.^ . ...^ 

- the key words ind phrases that set the computer 'thinking'. Thiey include subject terms* test names, authors and 
descriptors. 

Boolean logic 

- two ideas may occur indtvidually (OR).' or must occur together (AND), or must not occur together (NOT). 
Organizing relationships between data in this fashion is Boolean logic. Computerized searching of ERIC operates in 
this way. 

Broader Term (BT) 

- part of the notes of each descriptor in the Thesaurus referring to a subject heading that's more general than another 
heading. For example, reading is a broader term th^ remedial reading. 

- initials for Current Index to journals in Education, an index to current educational journal articles; published 
monthly by ERIC. 

OtaNons - 
■ the refe r ences that may be retrieved on a particular topic. 

* Oearinghouse ^ \ 

- centres where current educational inatcrial is indexed and abstracted on its way to the ERIC data base. 'Additions are > 
published monthly in CIJE and RIE. Of over a dozen clearinghouses, one example is the ERIC Clearinghouse on Harly 
Childhood Education. ^ j ^ * " • 

aient ^ 

- you, as user pF EISO services. 

Database- \j 

- all the information'' stored in a computer. It's also called a data bank and can refer to either numerical' or 
bibliographical data. 

Descriptor v 

- a term that "upon being sent to the computer will elicit all the references to it. The approved terms for ERICs datia 
base are found in the X'lesiaiiriis o/ E/?/C ^^scri^fors, 

ED number - » 

- the accession number for ERIC documents. It identifies a document in the computer. T^ese numbers appear in the 
/?«ourc:« m Ei/z^cafron index and on the computer printout. 
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EDRS . 

- the ERIC Document Reproduction Service ivherc paper copies of niatcria! on microfictics cart be ordered. 

- resource t>*non3 in various part*, of Ontario acting, as Bdwi^iorial . information Consultants. Jhcy have special 
knowleciseof how EISO works. " -^-^ - ^ ^ 

* the Educatioaal Information System for Oiitax^oVprovidagB^SS^^p^ information about'all aspects of 

. education^ • , . . " ^^^^^n^^^^ . , 

number . J - . - Jjiuoajfi^ - 

- the acc^sion number identifyins a journaf reference in .yii?^^^atSK Ita^^^M^ilvrtie'Ct^H'^gW^iff* ft>Jouma!s'in , 
£<fuca^*on and on the computer printout. ^ ^r^. V - - \L "^^^ . * v'^ ** * t - ' 

ERIC • '^"^.^ ^ ■ "^^ ^ Iv'^ ' V 

- the Educational Resources Information Center in the ySAv It produce^ the inde«^e^s k^iown as RIE and CIJEas well as 
the magnetic tapes that makeup the ERIC data base. . ^ ■» 

Hardcopy • " ' • . ^ '" - ^ . • " 

-also known as paper copies. The>^ar\ri^ade from microfiche prisma Is. ' . - * 

- Hits ^ ■ ' ' : . ■ ^ ■■ ■ . ' ' 

^ the number of useful references retrieved by the computer, search. ♦ ' ' 4 < 

Identifiers , ^ * 

- subject terms, proper nouns, including personal, geographical or lest names used like descriptors, but not yet on the 
approved list in the 772esa«ri2sc>/ER/C£5escn>fors. V ' ^ , • . ' , 

Microfiches 

^ - celluloid cards on which up to 96 pages of ordinary type can be miniaturized. A microfiche reader is required to 
make^xseof them. ^ ■ ^ - ^ : 

Microfiche reader . . ^ ^ - .r " • ' ^ 

" a machine that enlarges a microfiche and projects it on a ground glass sc reen for easy reading. ^ 
' Misses ' . ' . ■ - ^ ^ . ; ^ 

- the number of potentially useful references in the computer Tiof retrieved. ^ \ : ■ 

Narrower Term (NT) . ^ • ^ 

- part of the notes for each descriptor foimd in the ThesaMrus referring to a subject heading that's more specific than * 
another heading- For example, rirmc<f lii/ rciirf i'n^isr a narrower term than rtra*fin^. ' ^ _ 

- " - " ■ " ■ ■ . . ■ ' 5 ■ 

\ ^ ' ' • 11 . 

;■ . ■■/ ■ ; % . ■ . _ • ■ 
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-tV™inil!*'*"** references retrieved by a search at the location of the computer rather than on the Searrh Analyst s 
•TheOntaHo Institute for Studies in Education inTorcufito. Ontario, where EISO is located, | 

on-um -^^ r : ..Jl.^^'.. ....... 

- thedirect communication between the Search Analyst s terminal and the main computer. 
Printout,. ^ , ^ 

- the computer's reply, It^s a list or bibliography^f references with derails about each title. 

ndCTcnce « 

- a unit ot information on any particular topic. Also called a citat ion . 

RIE " . 

- I^urccs in Education, an ijidex published monthly by ERJC on current educational documents and reports. 
Related Term (RT) 

' b^oad^ nor nTrZ^Jr^''''^ descriptor found in the Thesaurus indicating one term is similar to another, though neither 
Relevance 

" appropriateness of a computer reference compared to what you requested. "N 
Rotated Descriptor Oisplay 

" * f^Jf " Thcsaun^ of ERIC Descriptors in which each descriptor is listed in alphabetical order according to 

each of the words in the term, For example, rem^dia! reading would appear under both r^edial and^^««^ ^ 
Scope notes ^jc/^ 
. - explanations of the way ambiguous terms are used in ERIC. ^ . ^ 

Search 

- the process of requesting information from the computer. 
^ Search Analyst 

'l.^t^rTI^ "^^""'X "5'"S computer search system, answering questions about education and 

obtamingfor you the information you want. --^ut ^uu^^non, an<a ^ 

Terminal ' _ 

^ - a specialized 'typewriter' that uses the telephone to link the search analyst with the computer. 

Thesaurus of ERIC Descriptors 

a special dictionary of words and terms, specially compiled to be used with ERIOs data base. - r 

Used For (UF) * 

- the Thesaurus abbreviation for synonvmns indicating what term is used for tntJcxing materials on a given topic! 
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APPEMDIX N: - 
EEUCATICJNAL INK3RMATIQN SYST1EM FOR ONTARIO 

" Xnte2^i^eij''~Sa7tedu ' for*' ' ERIC Sui*vey' 



Institution: 



1 



2. Phone number: 



3. Person contacted: 



4. Position: 



5. Is ERIC collection coirplete' 




I£ not, l^ow many fiche? 

ivhat topics? _ \ 



• What level of demand is there? 



/ 



6* Do you sr^jply on-line bibliographic searches? 



To idiom? 



XVhat price? 



What is your volume?, 



1 



ERIC 



■ . ■ . \ • ■ . 

APPE^IX N CCoht'd.) ^ . \ 

7. I£ not, do you refer others to search services in your area? 



8. Do you si?>ply fiche copies of ERIC fiche? 
What is your volume? - 



/ 

A— 



7 ■ ■ ■ - 

9. Do you sijpply paper copies of fiche? 

If no, are reader- printers available? 



^10. Qjmnients: 
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APPENDIX O: 

Institutions and Individuals Contacted in 
Survey of Search Services Searching ■ ERIC 

^Alberta Education Library, 
705 Executive Building, 
10105 - 109 Street, 
^ ^.Edmonton, Alberta T5J 2V2 

. "(403) 427-2985 ^ 

Ms. Catharine Perry, Librarian 

Brandon University 

Education Library, 
• Brandon, Manitoba, R7A 6A9 

(204) 728-9520 ^ ^ 

Mr. Terry Mitchell, Education Librarian 

Calgary Board of Education - 

^ . . , * Professional Library, 

307 - 55th Ave. 'w. , 
^ Calgary, Alberta, T2H OAl 

■ (403) 253-7271 

- '„ Ms. Jane Webb' 

D^lhousie University * 

^ Killam Memorial Library, 

Halifax, Nova Scotia. 

' " (902) 424-3601 ) 

" . ■ ■ • - . . - ■ ■ ./ 

- Ms- Janet McNeil, Reference Librarian^ 



Dalhousie Uiiiversity 



Mc Donald Science Library,/ 
Halifax, Nova Scotia . 



Mr, 



Frederick Kennedy, Librarian, 



r 
I 
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McGill- Universlry - 



Education Library, 
Montreal, . Quebec. 

(514) 392-8849 

Miss Elizabeth Minnie, Reference Librarian 



McGill University 



Medical Library, 
3655 Drummond, 
Montreal, Quebec • 

(514) 392-4339 

Maureen Wong , Computer Librarian-Reference 



Memorial University 



Library, ^ * . 

St. John's, Newfoundland. 

(709) ^ 733^1226 

Mr. Marshall Clinton, Head Information Services 



Mount Allxson University 



Ma"in Library , 

Sackville, New Brunswick. _ 
.(506)_ 536-2046 - . • 
MissJEleanor Magee,' Head Librarian 



^va Scotia Teachers'. College, 
Library, 

Truro Nova Scotia 



(902) 895-5347 . - ^ . ' 

Mr. Paiil Tlwana^ Acquisition Librarian 



APPENDIX O CCorit^dO ' - 

' The Ontario Institxite for Studies in Education 

252 Bloor Street, W* , j 
. . Toronto, Ontario , MSS^IVS 

^ ^ ' C416) 923-6641 \ 



Miss Jan Schmidt, Public Services Librarian 
Ms. Ruth von Fuchs, EXSO Search Ana^st 



St* Mary/ s University 



Librairy , ' 

Halifax, Nova Scotia. 

C902) 422-7361 

Mr. Murray 'Baillie, Reference Librarian 



Universit^ Laval 



. Bibliotheque General i 
Quebec,. P.Q. ^ ^ . 

(418) 656-2888 -, 

M. Claude Bonnelly, Directeur Service, de Reference 



Universite de Montreal 



Bibliotheque de la Faculte d '[education, * 
Montreal , Quebec ♦ * . 

(514) «a43-2742 



Universite de Sherbrooke 



Bibliotheque Generkle, 
Sherbrooke, Qi^ebec, 

1 . ' 
(819) 565-5457 . ' 

M. Roger Bemier, Dlrecteur, Service de Reference 
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University of Alberta 



Education Library, 
Edmont on 5 Alber ta . 



(403> 432^37J0 



Ms • Lynn Parker 



University of British Columbia 




University of British Columbia 



Main Library , , 
Vancouver , British Columbia . 

(604) 228-2725 ■ 
Miss Marilyn Dut ton 

Social Sciences "Division, Librarian 



Main Library, 
Calgary, Alberta. 

(403) : 2S4-6221 . 

Mr* .Oldrich Standera, Head Librarian ; 



UixiversitjT of Calgary 



f 



University of Manitoba 



Education Library, ' 
Winnipeg, Manitoba, R3T 2N2 



(204:) 474-8725 



Mr. Patrick Shanks, Head of Reference 



:aPPENDIX O CCont^d.O : ■ " - ' 

, ' . ■ . ■ : ' ■■■■ 



University of New BrtmsV«ick ^ 

■ . ■ ■■ . -f. . . 

- ^- Harriet: Irving-Library, * . 

^ ' , - Frederi<iton,- New Brunswick, E3B 5H5 
; C506) 453-4742 . 
Miss Gertrude Gunn ^ 
-Ms*; Ja.net: Phillips 



.1 

i 

i 



University of Sasldatchewan 

« Main Library, 

Saskatoon^ Saskatchewan 

V C306) 343-4293 . : 

' Ms. Lydia Friesen, Referene:e 

University 'ofc^ Toro^nto 

Robarts 'I-xbrary , ' 
Toronto, Ontario- ^ ^ - 

- ■/-, <416)- 978-6215 " ; ' 

.. Mirs- Sheppard,. Sea[rch. Editor " 



York University ' 

- : Steacie Science Liibrary, ^ 

; 4700 Keele Street, . - ^ 

Toronto^ Ontario . ^ 

C416) 667-3927 

' Mr . Brian Wilks , -Science Librarian 
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THE tENNSYtVANlA I^UQTIOKAL 

uiTto ^ifiilibk to. il edttdtoa k^'the 
Gonnmiltb, i tMit getwod: b bca 

iD (he R)k of a Raim UtOiaticQ 

iDiendifly'betm the kd ^ pa^ 
ten xnkaiQil^ fraDm I^^^ 
. the ;«iiak ill qpcQte i tMiy nK)iii/(i) 
U&Liilxqiirei&lbQ^ 
tkedoc^M^jW 
KIS£ wi piQiide rapQapcUbiniiioQ to 

scOQdB]fte(tioBoriliefletiQ^ - 

victlfitnit iQciie^^^ 
WqpwitJ wjf Bdadp sopiBiOD orthe 
oetvod to tttBiitt gMttpMHt jnffmtim floy ' 
JDd otb dited fjmt Lool distncts ia 
nMfvtidpiljai kmM Doits, 0 idl 2s 



bttn&Ddiiic Ibit Obc ' 
NorthatTiitay 

m.-^ 1 - 1 

Appiktii. 

CestrtI > • 

Tstctitn 

LdcoIq 

UKuteT'LAnoo 

Berblib; 



CifitilArei 



CirboQ-LdM 
EocbCa 
HootpnoyCa. 

DelmnCb. 
^'^BcmViJcy 
ASIN 
Sdmyldl 



Iilvitdte U« M ftt itt nd Moil 

Ik VQii imbM or wfM M m psfovd 
yw^tb qtflf Mitprtifwikflnof.Md 
pcanst Roif^ opiiipiiapNKd bCR^ do pot 
ami^ idkd foitioi a potter of Ik tad^ 



klQULifl^SEKVItE 



' pIicethdriqDcit.tliioo{hthe Il^ 
Specalifl Iq. tbdr fopectm latennediate Unit 
Moat^ Cooaty LU. eduaton should oD or 
iniie Einnu htcnoD at Ri3£. Flew iote 
yocr dmroi eodoie ptyneot (if ootadedieot) 



tiam k. non^gnkipaiai itumeiiese 



Ibefoptioo for obtsoiai 'xjnli nutoiab aie as 
follow ■ 

dopGateofKudipack^ 
(toadt cSenls will bc dmpd J2Si)0 
. (i3S^ODts)r-tttc)o(tal coitS'aia(e 
wliidieicr is {later. 

Sekctiie .Ropofise - OkBt' ietim tn 

stidcs tUdi he chooses to the seanh 
' / btblioppiQr* Oatdde cS^ 

{lift (SIOOO for Ik xto lespoiise aad 
V OfbrtheUljo|i]^ 

fiibliopphto - Qiest-rtoeiics tk setdi 



OtALKBhUop^ 
' tecdies .QCjonQ m Joosd or ERIC 

, CotiKt RISI. Ibr omt policy 00 costs 
'.'ttdscnto) , ' ': ■ 

' RJiZSTAFF: * 

'ftpjccJKrwor-^ 
' ; AflistiDtP^Dbct^ 
Uodo - J w KttDctt 
" lotanaitioiiSpeddtf-Einnti]^^ 

. EncstiKMtt&t-Ldi^^ 
' ^ Ambodzed. Aivt W Gtatee * Ite Hulcen, ' 
y Exocvtive QsKtor,, liQot|my,Cbo^ 

OSiSOww UDl 

, . * ftviyhihtt'Bi^irteeot of EdQCitio& 
Adiin-' ■ • ■ ' V " ■ ■ ■ 

.ofteEdncittai 
ih L JMj, Director, fim V 

,. ' -nalM|lwU]lUIUOiL ' 



O in-! 



hpjKt UlE i mMf m edMooiI isfor' 
Qitio& ctiitcr dnotol to pcDiidioi cdocitioiul 
docidoiHQilm with fdnat iafooutioQ dm 
fm ttboeit, ittte, R|loQit'tial Iixil 
' Import of thdf proWena ai 

pDoy Coialy 'Isiaaofitif Uaic t&d Buien of 



sot of EdQcitv]Q« It b caneatly cpe^ 



■V 



r.ise.inf.ormation'resources 

Title in popniepoits . 
Edin^Re)oimlsf(m^ 
QsitDl loda to Joomil^ to £diicitioD(^ 



SdKtedCimhniHt^ 

KitiOBd iodejdDixrficci 
UWPACj . . ; , •• V 

XmConicoIun llitai^ . . 

Coopentm ftaocsts wift other ittfocnitioiiil 
Wm 8 EdnctfiODal Tcstias,Senix ad 



RJiE,UTERATURESEARCH: 
' PiHlitpsthenostinportut-tndc^ 

of roearcli iofocmiiGn 'reports, tint is, (be ead 

' ptodixt of } Utenton nid Eli 

- .Rttltiat repon is iKlividuBytai^ 

' qi)estiooid;edbyaipecilkcfi^ 
K is thus la a«y sense 1 itspoosive senice, gevcd to 
the M fleedl^TniDed nrcbeis leceive a searii 
itq&eit,Dcptiitewi!h^^ « 
IiisreqQiiaDeflts,t9d(bQQ^ 
imbbk mm to' locate tod retrieve nateiial ' 
beiri&{ directly oo the qoestioQit ime. Ihe result is 
apsctateofbowle^ 

priQt<oatSr biblkippiiies, atntncts d other 
QotaiiL Seiidies'iniy deal with, for jostaoce, the 
ilrDCture of the iniddle ijiool ot the QQpded 
or school stitdeot the task is toxome up 
with peitineot and reliable data coocening any, 
qocstioo asked aboQt soy Iqitinute edticatioiul 
coQcem Ibe-sesch procen cti be either manual or 
coQiputer Of both* ;(Micr fonns of' infonnatjoo 
diacnitatioD jadak' .ready .iefcitnce, adectcd 
'disseninatiOQ' picbge; ai»l_ dtiplieates of oiisiaal - 
scaidw. RJiE. pirfes lQ,'"prOTidc its products in* ' 



cod 
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Ptepntioa aod dttnsioatiQO ofteseardi,' 
infocnatioQ reports (itiiews oflitenture) 
Ready referencenvices 
Imish aod diBfiniiatioR actirities .and 
infofioatiOD services 

FublicatioQ propn iododiif oocaiioul 
p^ bibtiopfliies, spedd reports and 
ltate<lf'tb^^rtpipenolIJpecifictopics 
Coopoter aod'oaDtol aifoa&atioa retneral 
inn ack natiOQil lexdoices as the ERIC 
colectioQ 

DisromtknofESEATilieinact^ 
DisuifiiflatiOD of pfoansiot edocatifloal 

DiftaioD of oatioQil' abd state lalidated 
pnpns 

DiieninatiQiortkctedcsni^ ^later^ 
lis sudi as ieantfitj packets 




■ COMPUTER DATA B-\SES . \ 

Through (he Lockhtdcoapote^ 
RJSE'has access to a oombei of educatjonat-data 
;ba)esoD{Qe.lheya:ecfollows: 

,£lUC*(RlEl96^rejeat)(CDEl9«9i»escnl) 
. .ERlC-EC(E«eptiooalChadto)(^^^^^ . 

AIM.'ARH - (Vocatjooal-TcdirDcal Educatioa 
/• .docfflijent$){196$-(lrticnt)' 
^ Psydiol(iWAbitracts(I9S7-prcK^^^ ' , 

Sodal SciciKc Gtatiott Index (!972-prcjcnt) 

^ Other data bases in en{iDceriQ{, apoiltmt: 
ecoQotnic; busDcss and the soeoccs are also ava^^ 
thoBjb not as widely osciAnyorall of thcdita files 
ooy k seardied to locate relevant rnsteriti for a 
KLStLscaidL 

TITUlI!F\CIUTATORPROJEa 

; has bees ronedFbnnyWs kite 

the nevTitle 10 thnst in-tbe edocitiooslareas. 

RiiiiscoopaitiajwithA^rrtlcm 
^hnsyhm Depirtmt of Educatktn and USOE 

Title in Dtvisknofnansaoi^^Siippb^ 

inthiscfTort , 




, Hie role of RJil, wH be assiii^ districts in 
ideiiti^ ixeds and initchiQ thoK Deeds wil^^ 
■ podof^ipropriateiohtkiasIiQnitttip^ 
resQurcet Tk Bokiiit begintiiis with the 

' disseoiioatioa of aforntatioD at the interest and 
iwazcDessbelsiabeexteQded into the din^ 

' pnmdifls tedoicaI,aBstaDce to districts to aid thon 
io adapthis or adoptinj (he.need;{Baldied identified 
prognot 0 1' 
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' / ■ " 1 ' ■ ' ■ ' . . . . • ■ 

/ SAN MAIEp. COUNTY OFFICE OF EDUCATION 



SifERCl RESOURCE GUIDE 



EDUCATION RESOURCES CENTER ' world of 



333 MAIN. STREET 
R E D WOO D C I T Y , C A L I FO R N I A 9 4 06^3 



415 364-5600 




California 



Curriculum Guides 



1975 



INTRODUCTION 



Thm collection and dissemination pf anrriculum guides has been a concern of 
California educators for wany years. It has always been difficult to obtain 
copies of ^the guides J. and, after collection, the physical task of providing 
copies to interested parties' has' been virtually impossible , " ^ ^ 
problems, the guides have not always been available. . 



Because - of ■. these 



The San Mateo County Educational Riesources Center. (SMERC) -offered -its services, 
to the County Superintendents of Schools asj a- collection and dissiemination, . 
agency, it was the intent to provide a yearly catalogue listing all of those 
guides submitted by county and local educational agencies. JThis is- the second 
volume\f the Cxzrriculum Guide series^. The firsi volume, the 1974 edition „ - 
published in^January, 1975, is still available fr^m our office at a cost of 

Tpe Curriculum Guide Catalogue is not intended as an evaluation aid. Its 
purpose ik to provide a stat,e-wide awareness of curriculum guides ^ produced . 
during the year. The Catalogue has three sections: .A Subject Index, an ' 
• Institution Index, and a Summary Section. All guides are originally listed 
in the Catalogue by a "CM" identification niiinber. This "calV number is the 
one to Jbe used in requesting a^ specific guide.. All .documents cited in this 

■ Catalogue .are boused by SMERC in MICROFICHE FORMAT . . . 

■ - •■■ ' ■■ ■ ■■ ■ " ' ■ v\ 

The Subject Index lists all documents'by subject areas. The Subject Index 
will enable you to locate the. documents that are of interest, to you. If^ you 
want to know what guides have been developed by a certain district or school,^ 
check under its name in the Institution Index . : If you are uncertain as to the 
document content, check under its title in the Summary Section. A brief 
description of the document follows. 



F. Curtis May, \ ' 

Director of Library Services 




-rank W. Mattas , 
Administrative Director 
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SAN IIAIEO COUNT? • ■ ' ■ - 
• EDUCATIONAL RESOURCES -CENTER .. 

SMERC provides Information service to all educators in Sau Mateo Coixnty and to its- 
..participat±ng,:ineinber groups* Its resources include ERIC .(Educational Resources Infor- 
viBti^^ Information Data Organizer) , the Prof essional Curriculum. 

Library* and many specialized -collections. 

All collections emphasize new publications in emerging fields of. education incaudlag ; 
new books concerning various disciplines in a broad range of subjects; ctitxlcolum 
guides* policy handbooks,,, and other national, state and local publications; more than 
70G periodicals and newsletters regularly published by educational organizations and 
related agencies; and^ directories and pamphlets published. by the Office of Education » 

.Access to the storehouse of educational research and resources is provided t:o all 
'San Mateo County teachers and . also , through ' contract ^ to teachers and admlnistriftors v 
outside of San Mateo County. Expert researcliers probe the computerized files of - E31IC 
and FIDO upon request of • its subscribers. , /Information packets; of ..microfiched documents 
photocopies of journal articles, and bibliographies of abstracted -documents are supplied 
to clients « 





.. /V CURRICULUM MATERIALS DEPOSITORY 

School. Districts and jCounty Offices in California are encouraged to 
participate in the Curriculum MaterialsDepository . In order that materials 
prepared by all districts nay be made JB^ailable to all interested persons 
you are encouraged .to send any curriculum materials produced since June, . ■ 

1974 to the address below. . * ^ — . 

When sending materials, we ask .the ^ollowi^g: . . ... 

> 1. Send original copies or good printed copies. We cannot . 

photograpli from poorly printed. script^ ditto copies, etc. / _ 

2. Please'send two copies of each document if at all possible. . - 
.'^^ One copy should be bound in the usual fashion and one -copy 

•V '. unboyiid. ■ ' ■ . ' . ~~ . 

3. Please^ote on the-title page the availability of . the 
original document from you, i.e., the price if for sale, 
the address to^ which a person shoulci write, or the. fact 

that pip-'inted copies are not available. . . ' 

' . • ■ ■ •* ' . ' * ■ - ■ . 

, 4. Send the .documents as soon as produced , on a year-round • 
- . ; ■ basis to:" " 

' ■'■ • ' ^- , * ■■ -■' '. " ' • ■ ■ ■ ' ' ' 

' EDUCATIONAL RESOURCES CENTER ' ; / • 

Curri<;:ulum Materials Depository ^ .. - 

. ' - San Mateo County Office of Education 

\ ' ♦ ■ 33.3 "^Main Street • ' ' ' o.^/. 

• • Redwood City, -CA ,94063 r^r^fj-r.^- ' ' • 

1 0ft . • 



ORDERING INSTRUCTIONS 



Any educator may request microfiche reproduction of the curriculum ; 
guides, A charge of 50c per microfiche card will be made, and ail 
microf iche materials are the permanent possession of the client. 
To determine the number of cards- for any '/specific document: not^. 
^he nuihber of pages in 'each document, es/timating 46 pages on the 
first microfiche card, and up to 60 pagers on each additional card. 

Standing orders are offered to any institution at a. cost of 35c 
per microfiche card* Institutions* wiSi,y^ the complete collection 
may order.. at the follox^ng prices: _ 

r . ^ . . 1974_ volumei 518 titles .- -^SSO : . - ; 

■ 1975 volume.,. 296" titles '-■■.$^^^ 

Please note that complete collect ioh orders are subject to a delay 
• of '60 days. 5:uiirent microfiche will be sent .quarterly for standing 
orders with' the appropr:^at:e billing. The Cvixriculum Guide Catalogues, 
^including this second- voliime, are available at a charge of $3*50 each. 
The Cat alog;ues are furnished free as a regular resource guide to ^ 
subscribing, agencies. 
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V AN INTRODUCTION TO SMERC 

This handbook Is a compilation of - miscellaneous information about SMERC~±ts 
^e<iple, its policies and resources » its pubjfications and Jargon. It is 
designed as a reference which ^^111 help you dealing with your clients— and 
In dealing with SM^C* . ^"--A^ ^ ^• 

Contents" u • v Page 

!• SMERC Organization Chart (abbrevdD&ted) . . . , ^^ . ; . . ^ 1 

II. Subscribing Members • • 2 

III. COSMOS ... . . . > . • ^ • • . ... . . 3 

IV. SMERC Data Files (Chart) . . . . ... . • . . . 4 

T. ^ffiRC Resources . . . . . ... 5 

VI. Types of Searches . . . . . 8 

VII. Policies & Charges - ^ ^ 

A. For Subscrib5,ng Agencies . • . • ... • . . . 9 

B. For Hon-Subscribers . . . ^ . . . . . . . .10 

VIII. SMERCi Publications 

A • - ■ ^ ■ ' - 

Regular Publications . . . . . 11 

'B. Distribution of Publications. . • . . . . . . . 13 

IX. Submitting Documents to SI-IERC for FIDO: - . • . • .... . 14 

X.. ERIC Clearinghouses . . . . . . . ■ . 16 

XI. Glossary. . . . . . . . . . . . . . . .. . ./ . '.21 

XII. Microfiche Readers and Reader/Printers. . . • • • . . - . 24. ^ 

XIII. Thesaurus of ERIC Descriptors (Ordering Information) . . . 26 > 

XIV. EDRS (Ordering Documents from ERit;) . . . .... . . . . 27 

XV. SMERC Forms - 

A. Document ordering from a computer printout . . • . .. . . 29 

B. Sample Computer Printout Page . 1 . \ . . . • . ; . 30 - 
Cm S^ple ERIC Abstracts . . . . ... f. . . . . . . . 31 

• 'D; Transmittal Letter . . . ^ ' . . . . . . J % : • 32 
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SMC ORGAlIIZMp CHART (ABBREmiED) 
, . : ffl)0iie!, («3) 364-5601)) 



•■ Barry Galvin, &ii3/&3se:i2sr Cierk ■ 

■ -4 ' 



I 



Frank Mattas, Director'' 



Pat Bniha; Secretary 



(Phone, ext^ 4404) 



Suelongj, 

Field Consultant - 



Katheriae Clay, . 
InfonnatioD Specialist. 



'^^^■ji^ ^.>..'^^-^ice Supervisor 



Lillian Reisland, Secretar; 
(Phone ext. "4403) > 



Research TeaiE A ext. 4405) Research Teas B jPhone ext. 4407) '' ■ Research Tea C (Phone ext. 4408) 



Linda Spencs, Research Analyst 
.June Henrig, Research Assistant 
iiana Joa, Research 'Assistant 
Holly Wamke^ Research As'-:^^^^ 
Lee McNeil, Clerical Support 



^ !(aren Cole, Research Analyst 
. ' Mary :,o D'Anna, Research Assistant 
■ ■ fethrjTi Ilessler, Research "Assistant , 
; Nancy Mi-r, Research Assistant' 

.'taka Sonoda, Clerical Support 



Sara Lake, Research Analyst 
•Elissa Shafer, Research Assistant.,' 
Jean Holbrook, Research Assistant- 
Judith Ehret, Research Assistant.:,- ■ 
'Lorraine Wilkinson, Clerical Support 



SUBSCRIBING MEMBERS 



ALAMEDA COUKTY ^ 

Lorctta Chtti 

<A15) 881-^72 
ALASKA, STATE pF^ ' / 

Dr* Robert Lehman 
. (907) 465-2812 
ARIZONA^ STATS OF " 

Dr. Jackaon Drake 

(602) 965-3538 

CtA 

. Audrey Ohlaon 
.(415) 697-1400 
EL DORADO COUNTY 

Robert Haynea 
(916) 622-7110 X 52 
INDUSTRY/PJ)«CAT10N COUNC-I L 
Ilcnry Welaa 

(415) 697-4311 / 
INSTITUTE FOR PROFESSIONAL DEVELOPMENT 
Dr. John Sperling 
(408) 262-8500 

nnro county 

Lloyd Wilson 
. (714) 878-2411 x 345 
KERN COUNTY 

Jack tCeene/ Sandy Laraon 
. (805) 834-3700 x 364 
LASSEN COUNTY 

Lois Weston^ Marek 

(916) 257-5144 
LA VERNE COLLEGE 

Dr. Marlln Heckaan 

(714) 593-3511 x 211 
MARIN COUNTY " . 

Gerald Foley/ Suaan Van/Keulen 

(415) 924-9500;^ . jf . 
MASSACHUSETTS (ZE^jWC) 

Holly Stengel 

(617) 256-3985 
MENDOCINO COUNTY - . 

Alford Wrlgh't/Elffle Snider 

(707) 462-4731 x 371. 
MERCED COUNTY 

Vlnce Caapl - Library ■ 
• (209) 723-2031 
MINNESOTA, STATE OF . 

Donna Ford 

(507) 537-7141 j * 

Helen Dell 

(612) 596-5079 ^ 
MONTAKA^r "STATE" OF T " 

Marianne Whlcmore j 

(406) 449-2082 
MONTEREY COUNTY 

Lois Casey 

(408) 424-0654 
ORANGE COUNTY 

Don Wilson/ Jean Hayes 

(714) 834-3981 
OREGON (BORTIAND) ' 

Jean Seay 

(503) 234-3392 x 267 
OREGON (JACKSON/JOSEPHINE COUNTIES) 
- Ralph Humphrey 
(503) 779-5510 



PLACER COUNTY 

Dr. Martin Bauman V 

(916) 823-4611 
RIVERSIDE COUNTY . ^ . 

Dr» Adrian Gentry/B, Falrc'hlld 

(714) 787-6550 
SACRAMENTO (FOLSOM-CORDOVA DlSTRICt) 

Floyd Andrus 

(916) 985-4483 
SACRAMENTO CITY UNIFIED 
. Ted Porter . 

(916) 454-8561 * 
SACRAMENTO (SAN JUAN UNIFIED) 

Ray Dlmond 
. (^916) 484-2541 
SANTA HAkUARA CDUNTY 

MrH. 'Kettle Day ? 

(805) 964-4711 x 247 
. SANTA CLARA COUNTY OFFICE 

Susan Choi 
- (408) 299-4096 
SANTA. CLARA (MORGAN" HILL UNIFIED) 

Gordon Logan ' . . 

(408) 779-5272 - . 

SANTA CLARA (MT. VIEW/LOS ALtOS DISTRICT) 
■ . Milton L, Schmidt , . . 

(415) 968-6571 x .40 
SANTA CLARA (OAK GROVE DISTRICT) 
1^ D. James Hastings 

(408) 227-8300 x 156 
SANTA CLARA (LOS GATOS . JT. UHSD) " ■ 

Paul Collins ^^ 
. (408) 354-2520 - • 

SANTA CLARA (EVERGREEN DISTRICT) 

Margaret Ce'resa 

(408) 274-2520 ; , 

SANTA CLARA (GTLROY DISTRICT) 

Mrs. Krnnoes Tret tin 

(408) 842-8285 
SANTA CRUZ COUNTY 

Dr. -Kenneth Larson/M. Segarlnl 

(408) 425.-2306 
SAN M4TE0 COUNTY . 

Linda Spence 

(415) 364-5600 x 4405 
SOLANO COUNTY 

Peter Kalamaras 

(707) 429-6531 
SONOM^ COUNTY 

Ctesylla BlacIcwlH 

~ ^^(70T)r52T-^43 7 ■ ~ 

TULARE COUNTY . . . " 

Sabln Gray 

(209) 733-6434 
TUOLUMNE COUNTY 

Kathy Anderson f - ' 

(209) 532-1419 
YOLO COUNTY 

Mrs. ShlpitSy Waltfers " * 

.(916) 666-8421 ^ 
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COSMOS 



COSMOS has nothing to do with metaphysics; It Is just another acronym 
standl&s for County of Sau Mateo Online- System, a computerised Infozma 
retrieval system .designed specifically for SMERG.by Dlglta]^ Equipment 
Corporation* \ ^ 

The computer temlnal, whether It be attached directly to a commiml-*. 

cations port or via dia-in telephone lines , will be commimlcatlng with 

t. - 

a Digital Equipment Corporation DECsy St emr-1080 Computer System .r It Is 
the largest cpmpjuter - that DEC produces » and Is located at the County 
Office of Education In Redwood City, California. 

The ERIC portion of the data base x^s purchased by San Mateo County, 
from ERIC headquarters In the form of magnetic tapes. Upon receipt of 
these tapes, programs were devised to load, their contents onto disk in 
a retrievable and logical format. 

SMERC's fugitive, or non-ERIC, files whiih have not ^evlously been 
computerized, were loaded into the: same datid base as their -big brotber 
EBIC and are now searchable by computer. /"included in the non— HIIC 
portiottvOf the COSMOS data base are six^yof SMERG's* special document 
collections, eacb of which has its own unique "call"- letters: . 
. * ID « FIDO - All Topics 

: V . CM « Curriculum Materials 

. UN = UNIPACS - Individualized Programsr \ 

•> SC = Learning Centers - Individualized Topics 

PR = PERI Documents Administrative Topics 
- CE Career Education Docximents 

In addition to COSMOS processing, the' DECsystem-lOSO wlll^while away 
its idle moments 'monitoring studenjts, payroll records, and performing 
other, County tasks* / ^ ■ ' 



SGSC Data Fllei 



m ' 


ORIGDIATOR 


SCOPE AHD/OR COSTENTS ' 


CO!1POTESIZED? 


KEPT 

COHSJT? ' SIZE 




to RIE ■ ■ 
(Resoorces In 
Educatloo) 


Sat'l Instlt. Research, Reports, CDrrlCiyyes/DIilLOC and 
of Education etc. oa all aspects of ^ COSMOS 
, eduatlon . • 


yes 


about 120,000 
docuaesti 


no/Got't Frlatlog . 
.Office 

/ 


ED 


af .' 


EUC CUE - 
(Curreac Index 

to Jipuiuils in 
Educktion): 




• Indexes over 700 
educational joumals» 
oalnly USA 


yes/OIALOG and 

coaios 


yes 


about 130,000 


no^calllan 
Inforoatloni Inc. 




PC. . 


FIW (fugitive, SHEEC 
InfcH^tloa Data • 
Organizer) 


All ed. Issues of interest, 
to our clients.' Also 
locally developed oaterials 


yes/COSMOS 
selectively 


yes 


; about, 5,000 


yes 


ID 


of If over 
Spp. PC 
iflds 


HATEEIAL5 


smc, as 
state currlc. 
depository ; 


Curric. Guides, lesson yes/COSMOS / 
plans, syllabi, handbooks, 
, etc., developed by CA schools . i 


yes 


about 1,000 „ 


yes 


CX 


uf . . .. 


tiaiPACs 


Kettering 
FouodatioQ 


Individualized student 
lessons, all subjects H2 


^yes/COSMOS. • 
selectively 


no 


about 4,j)0IX 


no/lndivldual 
HHIPACs Indexed in 
COSMOS \ 


ON 


. uf . 


LEABNING 
CENTERS ' 

t 


Santa Clara 
touDty , 


Instructions for setting ' 
up classroom learning 
centers on specific topics. 
All subjects, luainly K-8 ■ 


yes/COSMDS 
selectively 


no 


about 600 


no/lndlvldual learning SC 
center Indexed In 
COSMOS 

f ' ' ■ • ' 


of.; 


'CAREERED 

MICROFICHE 

COLLECTION 


SBERC, for 
Calif, State 
Dept/of Ed. 


Career edxation lessons, 
oalnly student avareness 
Wr. College 


yes/COSHOS 
selectively 


no 

/ . 


about 300 


yd/ID, 00U15 , . 


CE 


,nf. . 


EDUCATION 
INDEX 


H. W. Wilson 


Index to over 200 
educational journals 


no 


yes 


-'unhovn 

0 


u)/a.V. HUsoa ' 


Qooe. 


pc ■ 



CURRICDLIJM S.M. County , on education and teaching. 
lIBRARr ■ . . Saaple currlculm and texts 



yes about 25,000,. 
volumes; 

' • about 1,000 
journal ' 
subscriptions 



no 



none 



on loan to 
Comty - - 
■sctaoi ■ . ; 
personnel ' 



SMERC -RESOURCES - 



ERIC • Educational Resources Information Center 



ERIC,* a nationwide educational information network, acquires » 
selects 9 abstracts, indexes, stores, retrieves, and disseminates 
significant and timely educational materials. ERICAS central 
facility is in Washington, D-C.*; the sixteen clearinghouses, each 
specializing in a specific subject area, are located throughout the 
United States. The abstracts of educational materials selected 
for the ERIC collection appear monthly in two ERIC catalogs, 
RIE and-CUE* 

RIE - Resources in Education ("ED") 

RIE is prepared monthly by ERIC and is published by the D^S. 
Govemmenr Printing Office. .The catalogs "contain subject, author, 
and institution' indexes as well as document resumes which describe 
the contents of the document. The subject index is based on the 
educational terminology accepted by ERIC and listed in the 
Thesaurus of ERIC Descriptors > 

CUE - Current Index to Journals in Education . ("EJ"> 

■ ■ \ : ^■, . ■;v ■ ; ■■ . ■ ■. r ■ . 

CIJE, also prepared monthly by ERIC but published by McMillan 
^ Information, is designed to provide coverage of the vast amount 
of literature published in educational journals. ERIC has . 
identified approximately 70G publications; representing the core ^>,- 
periodical literature for the field of education. The Journal ' 
article citations contain bibliographic data but, unpkike RIE • 
citations y contain 'little more than a one-line aniiotation^ Like 
, ' docmnepi^^ in RIE, the Thesaurus is' used for ^assigning descriptive 
. tenn^>t:o each article, ' ; 

FIDO - Fugitrjfe Information Data "Organizer. ("ID") 

, FIDO is SMERC *s own collection of documents which have been 
determined to be of interest to educators, but which are not 
found in any othetr. known collection of educational materials. 
— r ----^ -Identif ied^s -"^^ 

indexed and abstracted in the same manner as those found in ERIC 
publications; the Thesaurus provides the educational terminology 
^ for abstracting, indexing and searching FIDO. FIDO enables 
SMERC to have on hand locally signif icant educ'at 
which may "^not appear in the" ERIC* collection. The FIDO catalog 
* consists^ of subject ^ aiuthor, and institution indexes along wixh 
a summary section describing each document. 

LEARNING CENTER PACKAGES ("SC") 



A Learning Center is a program designer! by the teacher to provide 
for- the different learning patterns^ of studtents, to leadT them to 
assume- the responsibility jof solving problems through exploration, 
and to offer the opportunity for success at the learner's level of 



achievement. The Learning Centers ^r Stations are designated 
areas within the classroom where children may go to . explore an 
activity related to some new concept or reinforce a par titular ly- 
difficult class-related skill. ' - ♦ 

E a ch learning center has a suggested grade level in parenthesis 
following the title. General grade levels are indicated by 
PR (primary), EL (elementary), IN (interniedlate), or HS (high 
school) . The majority of the packages are for They do not 

- contadLn- ob j ec t Ives i 
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UNIPACS ("ON") 

- • * ♦ - 

y ^ . Unlpacs are indlvidvtallzed program packagiets i^ich include a single 
concept^ instructional objectives, pre- and post-tests and 
diversified learning strategies. Unlpacs include; ' 

1. A major goal and its component ideas, skills, or 
attitudes ^ 

2. Learning objectives stated in behavioral terms which • 
contain expected performance, conditions, limitations 
and expected proficiency levels, ^ ^ * 

3* Suggested instruction strategy / 

4. , -identification of .learners ~> . , - ^ 

5. Materials and equipment needed* to reach the goal (often 
a specific textbook) 

6. Suggested follow-up instructional opportunities 

7* Example teists (both pre and post) with an^er keys 

■ ■ ■ > . ' 

8. Evaluation forms - - * 

Unlpacs are indexed under general grade levels^: primary, elementary, 
junior" high, secondary. ' • . 'v: -ii"^ 

CURRICULUM MATERIALS ("CM") ^ . J . . / 

The California Curriculum Guide collection is designed to provide 
a state— wide awareness^ of -curriculum guides .producedVby the various 
school districts in the State of California only . These guides are 
V „ abstrg-cted and indexed by the SMERC staff, using the Thesaurus of 

ERIC Descriptors , are available in microfiche format,^ and are computer 
retrievable through COSMOS* ^' 

CAREER EDUCATION/CAREER AWARENESS MATERIALS C^'CE") 

Career education/career awareness materials were collected by the 
California State Department of Education. A catalog of these 
materials was prepared by SMERC; it includes titles of curriculum. 



instruction, guidance, and management materials for career 
education. The documents are available in microfiche format, 
as is. the catalog itself : order ifTD G04' 715. 

PROFESSIONAL LIBRARY 

The San Mateo Coxmty Office of Education library houses a solid 
collection of professional books and a basic reference collection 
plus most of the journals cited in Education . Index and. CUE. 
Though circulated only to San Mateo County educators, iheee ^ 
/materials are often used by the 3MERC research staff as reference 
niate^jlals for other subscriVing agencies* 



4r 
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- . TYPES OF SEARCHES . / 

QUICK IDENTIFICATION SEARCH 

If you have access to SMERC newsletters, SMERC resource gtjdLdes, FIDO atid/or 
ERIC catalogs^ you may want to locate your bwn ^inaterial,^ and siWly phone 
ypur linking agent to give him the identification numbers of the document 
you want. The turn aroxmd time is 24 hours from the time we receive the 
request., There is no charge for /.this service unless the request exceeds., 
the maximum all<Swed. (See^CHARGES) ; - * 



COMPUTER PRINTOUTS , ^ . 

We can also provide you with a computer printout of ERIC doc umen t citations 
in a giyen subject are^.^ When you receive the/printout, yo^u.can then 
analyze the results yourself and request needed docimiei^s^by identification 
numbers. The turn arounff tlinc is 10 days^from the time we receive the 
request. , There is no charge for a negotiated compute^ printout; tlie only 
charge would be .if . the request for reproduction exceeded the maximum 
allowed per search* (See CHAr6eS) 

IW-DEPTH SEARCHES 

If you requ:^^ research on a given topic, and want the search prepared^ 
conducted, analysed, and reproduced by our staff, the in-depth search is 
perhaps best. The turn around time is 14 days from t^he time we /receive 
the request-. There is no charge for this service. 



POLICIES AND CHARGES 
FOR SUBSCRIBING AGENCIES 



10 free microfiche cards with eacX^ client-initiated request. ^ Each ■ 
additional microfiche card is 35c, or 3 for $1,00. ^ 

20 fre^ pages of photocopy with ^ach client-initiated request. Each 
^ additional page is 15c. 



3» . 20 free page^ of hardcopy (priat«||t of • microfiche) with eacli client- 
Initiated request. Each additio^Bkpage is 25c with a li^t of 50 



Aii-kuxi±tea request, r*acn aaaicio^MLpage is z:>C with a IJ^t of ! 
pages (including the lo free) per^|Hferch. ' Larger orders must be 
approved by the Research Supervisor and wiir have special handling 
charges.;.' These are a $2.50 per hour charge for reproduction time 
,and 35c. per page over the initial 50. All orders may be subject to 
a Arweek delivery period . (To aid clients in minimizing co«ts, . 
SMERC can supply the order form to Csecure hardcopy materials from r-^ 
i the ERIC Document Reproduction Service, which is able to provide 
hardcopy at lower costs. ) > 

4. Computer Searches / - . ^ 

a. A maximum of 50 free abstracted citations per search request—* 
15c. for each adctitianal abstract* " ■ * 

b. A maximnni of 50 free citations without abstracts per search 
request-^-lOc for opch .^riditlonal citation. 

c. Identi.f icatioTi nunihcr/titl^^, citations limited to 150 ut^% 
approved r>y lik^ V.cse^Tch Supervisor- • %^ 

5. $2*00 per cor-' (while Mit? o.tpply lasts) for extra FIDO catalogs or* 
Resource Gun -ins. 

■ " ^ ; . . ' . . . ■ ( .■ ■ ■ 

RESOURCE BrV KS- AVAILA BLE F OR F'JPCHASE 

■ - — ~ ^ 

..." Entire CE .•ollec.cit"n $200 

,CM ColIe-,Lir.-j : ' -^ - , 7 " ' ^ . ' . 

- .19V4 • '$550 ' 

^ ~, '>^ 19.7 5 Vol-in^ '^^SO ■ 

f ' ' l'>76 Vcl.ir::r. . . $300 . . .. ' • 
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POLICIES AND CHARGES 
FOR NON-MEMBERS 



50c for' each microfiche/ card reproduction (Note: One doctsnent may 
contain more than one microfiche card.) % 

^..^ . : ■■■ • - ; . • 1 • ^ •- 

^20C per page for photocopy of periodicals and' books* ^ 

35c per -page for hardcopy (printout of microfiche) with a^imlC of ^ . 
50 pages pet request. Larger orders must be approvied by the Research 
Supervisor and will have special handling charges. These Jare a $2*50 
per hour charge '"for reproduction time and- 50c per page over the Initial 
50 pages. _ All cftrders may be subject to a 4-week delivery period. <l£ 
requested , vSMERC will make available the -order form for hardcopy - 
materials from the -E^lIC Document Reproduction Service, which is able^^ 
to provide hardcopy at lower costs.) A 

A minimum charge of $3.00 when billing is necessary. 

Computer Searches ^ ' . 

a. :$35 per hour for a "batch" search, i.e. client .furnishes, 
descriptors aad SMERC does not negotiate, expand or^ limit 

the search. • . - ' ; • ^ 

b. r $50 per hour for a "negotiated search plus $15 per hour.^ f or ' > 

researcher' (personnel> timei * * " ' * . 

c. *15c per abstracted citation; lOc per citation without abstract.^ 

^ - , . '■ . ' - • 

$5 per copy for a FIDO catalog; $3 per copy for a Resource. Guide. 

(While the supply lasts.) ' . ' ^ ^ . ^ \ 

Search services are .provided for non-members only from^ June 1 to 
September 1. - ' ^- ' ^. • ^ V ^ 



SMERC- PUBLICATIONS ' . ' ' 

" ' \ ' Types of Regular Publications ^ • ) 

SMERC pursues an active publications pragram- to provide its client a with. 
' pert&anent references on new topics in education. It is our hope that our 
publications will be regularly read -by- our clients and that^ while -^hey will'- 
answer some questions, they will stimulate others in the, form of new search" 
requests., ' o ' 

We achediile one publication to. appjsar each month from September through'-May. 
.All publications are originated, written, and designed by the sHeRC research 
staff, although we encourage your iii^ut ^s vto topics you wish to have covered 
Our publications f^l jlnto three, major categories^ Collections - Catalogs, 
Resource Guides, and News' Notes. (Additional types of publications will be 
discussed beXow.O The general publication schedule calls for a News Notes 
to come out'one month, a Collections Catalog or Resource Guide the next 
month, foilowed'^by a News Notes, etc' " ^ ^ ' . 

fcOLLECTIOliS CATALOGS , . v - . " 

Fiftp Catalogs (Fugitive Information Data Org£fcir-er)::/vFIDO, is a 6>3^^^ -"^ 
.developed, by SMERC to answer ite 'own and , it's dlientsV needs. It- emphasizes \ 
topics 'X>f current cpncer^t (such as metric edncation, teaching i Vietnamese . ^ 
children), locally produced researchf .and curriculum materials I- (including:. ' ' 
Individualized ittstrructi^^ packets)sand topifes of special interest to * : ' 
.SI4ERC's contract areas (California education legislation, accountability).' 
•FIDO catalogs are published at irregular" intervals and do not- ctimmulatey > 
so each edition should be examined. FIDO documents are identified, by order 
numbers prefaced with the letters "ID", and are available in micrbfiche format 

Curriculxim Materials Catalog: SMERC has been- designated as the State 
Curriculum Depository for all curriculum materials developed by school 
.districts and county school systems in California. SMERC receives these 
materials from-the producing agencies, microfilms them and creates an annual 
subject-indexed catalog. While it contains little or ho research information, 
the "CM" catalog is an excellent .source ^of practical school information: 
course descriptions, subject area continuums, andi administrative handbooks 
and modeXsr» Document nujnbers are prefaced with "CM*', and are available in 
microfiche format. ^ : , 



-Several resource guides .are published each year by SMERC*, each on a- topic \. 
^ o£ current concern • ; Each guide contairis a thorough overview of SMERC'^s 
7;resources on 'thsrt : topic .. • First publl.shed and distributed to clients in V v, 
/..piaper cd]dry, resource guides are then microfiched to be. permanently avaiXa^ 
„ TOg^ f ollc?tiying' is a -list of resource guides current Available ,%%d.th pub^ca-- 
, tlbsi date and .\microfic he order number (all with an "ID" preface) . 



TOPIC 



DATE 



■ID UUMBEtl. 



•Environmental Education ^ 
Migrant Education 
Drug Abuse 
Year Round S.chodls 
Revolution in Education^ 
Decentralization 
Teacher Evaluation 
.Equality in Education 
Ajdministrator EJvaluation 
Open Classroom 
Teachers Resources Material 

Learning Centers ; . 
Emotionaily Disturbed Children 
Perf on^^ance Contracts^ 

Education VbucKers 
Decentralizatiori of 

De^cision llaking 
Early Childhood Educatdon 
Career Education . f 
Negotiations- (iieeting and 

Conferring)^ * 
Assessment Strategies 
Innovation and Change 
Comparison of Gui.dzs .to 

Non-Print Media. 
Individualized Instruction 
Altematiye Schools , 
Mainstreaming- - ♦ 
Curriculum* Guides 
Career Education .Catalog: 

(California State Dept. . 
' of Ed^ic^tion)* ^ 
Bilingual . Education- and- ESL 
Learning Centers I 



September 1970 
January 1971 
January 1971 
SeptCTiber 1972 
. January 1972 
January 1972 
February 1972 
April 1972 
August 1972 • 
June 1972 

Depember 1971 
November 1972 

^ December 1972 . 

January 1973 - 
February 1953 
March 1973 

- April 1973 

June 1973 

November 1973 
, December ^1973' 
January 1974 
February 1975 
1974 ^ ^ * 



■{'■■■ 



"January 1975 , 
November 1975 
-January 1976 



4143 ' r 

4144 

4145 

4146 
•4148 V 
.4149 

4150 : . 

4151 . 
4152 
4153 

4154 
4155 

4156 

4157 
4158 
4159 

4182 

4195.' 

4214 

4373 
4401 
4439 
4775 

4793 (also ED 103 



4715 
4899: 
-5032 



NEWS NOTES 



SMERC publishes bi-monthly newsletters . containing short articles and llstis 
of new or interesting documents on a .wide variety of topics. ' News JJotes.'- ., 
' also alert you to SKERC's new publications and resources. .. 



♦ 4*. 



- ■ ' glSTRIBDTION OF REGULAR PUBLICAl^IONS 



■J 



At the time of publication^ SME^'tdLll send a prearranged quantity of .paper ; 
copies to the main-office of each 'contract agency—enough so tliat each, school 
la that area will receive two copies of th^ publicatioiis. (Be sijre to notify 
SMEEC if there. Is a change in the number of your contract schools.) Actual 
distribution to the/schools is the responsibility of the li nk i n g agent in 
that contract. . " 

Since the number of copies printed each time is pSredicated on current Cand 
some future) contract needs, -once the origir^l printings is distributed, we 
cannpt guarantee that additional paper^copies will be available to yo^* 



Other SMERC Publications 



SPECIAL CATALOG'S AMD/OR RESOURCE GUIDES ' i ' -r 

■ ' — ~r ~ ' r r , .■>.• . 

If you wiuld like to have a resourc^:i 7;uide on ^ topic of special concern to 
your agency 5 please let us know. If it is a tojpic oi broadf -interest, we. ^y 
publish it as a 'regular resource guid^. We will also compile 6]peclal cqilecr 
' tlons and catalogs for your con txaiy; -alone,^if you wish. ■ This is a. speclk^ 
long-range • service which should be negotiated well In advance (perhaps -^s 
part of the yearly contract) with SMERC *s Director , Dr. Frank Mattas. ^ V . 

BROCHURE 

, The SMERC brochure is speciaM^y designed to introduce new users to^ our services- 
<. We.x-Tlll^ be happy to send- a quantity of these brochures to you for distribution 
to your schools^' or at seminars and conferences* ^' 



V5 



Linking logs , / - ■ - ''\<:/ ^ 

A new publication^ this is an :inf braal / irre^^ newsletter designed to keep 
our linkihg agents aj)reast-of things going ,on- at the SMERCroffice: .personnel 
changes,'' publications dates, etc. ~a general supplement to regulsar linking 
agent/research analyst coiimninicationsv We also hope it wiir serve as an 

idea exchange between linking agents in the varipiis contractSpV a place where 
problems -and successful practices in SMERC field work may be shared and ^ 
dlsciissed-; ■ We enc^i^age linking agents to submit ideas to Linking JiO^s. ^ . 




J 
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SUBMITTING .DOCUMENTS -TO SMERC. 



SMERC wants and needs locally developed inateiiials -for its data banks— it Is 
one way .fot. us. to know, more about: the needs and concerns 9f our clients and 
it gives tis new ideas to share with Others. (Someone to southern California, 
for example, may be tearing his. hair out next month trying to^ solve a problem 
that one of your districts tackled years ago. He wqul^ appreciate your help, 
and through SMERC, you can give it very easily.) v.". 

Sometimes, in our News Notes of in, our transmittal letters with seafehea^- 
we will request information on a certain topic.. Also, by examining our . > 
catalogs (FIDO, Unipacs, Curriculum Materials, etc 1) you will see the t3^es. 
of information we gather; But donVt: let; this, limit you. . Please be active . 
in soliciting materials from your local schools and feel f jee to.-sehd us any- 
materiai that you feel is worth.sharing with other educators: documentation 
on a successful local project, 'a research study done by the district office, 
an unusual elective course, a master »s thesis— Whatever . We will carefully 
evaluate al/ that is sent in, if you will please follow the guidelines set 
out below:-- _ ' ' ■ - ' 

(NOTE: "^pu do not have to separately submit for FIDO anthing that will come 
to us through other channels as part of our State Curriculum Depository 
program. The latter materials become CM documents. On COSMOS, CM and FIDO 
documents will be merged as a single file to search, we we no longer need to^ 
have duplications in the two colleGtions.) 



, GUIDELINES : 



FORMAT: Please send in a clean^ sharp, original copy-. Mimeo^ pale xerox . . 
copy, dark paper, newspaper p;7xnt, pencil drawing, and handwriting are not'. , 
legible -in micro fiche. SJs^sTll paper is preferred, because pages larger ^ 
than that, require two microfiche frames to film— and are difficult to read. 

AUTHOR RELEAsfe: If' possible, ,have- the author of the document sign^ a. release 
for the material to come, to -SMERC. If there is no individual author,, you 
.might ^request a signature from someone -who ."controls" it, such as • the head, 
"of the curriculum committee or the -district superintendent. - You' may ^se^ •. 
copies of the sample release on the following page, or you may make-^ip- your 
bwn^if you choose.". Please have the release s.tapled to the front cover :of^: 
the document when you, send it to SMERC- - ^ ' -.. .. 

SEND A "DISPOSABLE" COPY: We would prefer to keep the/copy ^u .send f'orjour 
files (in>-ease the. microfiche, is lost), b.ut we wiUv^eturn the :copy . i^ ;■. 
necessary. Please b& sure to tell us, when yon. subiriic la document , xf and to 
whom the copy should be^ retij^rned. 

SUBMISSION TO SMERC: Mail the document to th^. attention of your research 
analyst or to Mrs. Katherir.e Clay. ' ^ ■ . .. 

SMERC* s' RESPONSE: Once we have received' the document, we will ^evaluate it • 



; f or dncluslon in FIDO.^ - If we decide to accession it, witlj^n. a/- f ew days . . 
yoii will receive a note for the ^author, thanking ihiem for the* contribution • 
axid giving the document's order number. .If the documant itself is to be 
returned to the author; this will be done latgr, when the microfiche filming 

TZMELINES: .Z^^rakes about one month from the time a document :is jsiibmitted^^ 

■ . •* . 

uhtll it is available «fbr ordering ^s an "ID" microfiche* We can do a 
Vruah" job for one or. two special documents, but the time will never be l^s 
than a week and a half. Winter is the busy Jtime^t SMERC, so . things will ^ 
go smoothetf and faster if you submit documents in late sgjpiiig, or during the^ 
♦ summer, especially if you are sending a large batch • 

' ^ ' ^ ; ' ' - ' * * • . 

*Our other special collections, Unipacs,. Learning Centers, etc. are "closed" 
so eveiy hew" document we receive^ regardless of forDqat j will become a FIDO 
unless designated for' the 'Curriculum Materials Cat albg ot* for a special - 
^ catalog you negQtiate with SME^ < 





. - AUTHOIt RELEASE FOR FIDO DOCUMENTS - . :^ . - 

I am sending' this document rto SMERC with the "under st " . ...^ 

r;7."-\^'t]hat it.xdlll become "part o& SMERC^s d^ta files..- X give my; .y-];'^ -^ '.^r -^^y 
' t ; jttrmission:: for this article to be "placed on microfiche apdV^^^^^^ ->^ 
; ; : in' the f distributed at SMERC's discretion." 



SIGNED: .V. -. v ' - " " " : ; ' 'D AIE: 
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RESEARCH INFOflMATiON S£RVtC£ FOR EDUCATION 

. ■ /• . ■ \ Li brary ' 

The Ontario Irrstltutd for STucJIes In Education 
252 Sloor STroot West 
Toronto, Ontario M5S IV6 
r4!6)92>-6641 , Ext. 202) 
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Request for Literature Search 

Date material required^ 



! Nane: 








;- Post t Ion: : 








Address: * 










' - TeJeohoneMdav^ : 


2- Subject of fffiarch (Pleas© 


be as 


specific as oossLble): 


> ■ 












; - .■ - - ■- . :. . - i ■ . ■ 


iJse" to bo .madd^of materia 

















Level Ce.g*, elementarv, secondary): 

• - - * ■'f 

*Form des x red : .* " " 

Bib I iography 

Annotated b tonography 

Review of the literature 

Photocopies 



£17 

£Z7 . Yes - 
n7 Yes 
/ 7 Yes 



ZI^ NO 
No 
No 
No 



Cost : 

^Max i mum .cost acceptable CexcTudlng photocopies): 

Maximum cost acceptab le; f or photocopies: _^ ^ 

Bill to: Above / 7 Other* / 7 ^.Please specify: 



•^t«: 



signature: 



cr ■ 



: »wt IsRISR ■ ^, • 

, Jlif^^h 'ts-llesflifch InfofMtion S«n^^ for 
; , • Education, the Library of thfl Ontsrio Institute 
.. 'for.Studles in Education offers an extended 
■ reference service to the largsr educational ' 
■. ' ewDunity on'a relabursable basis. In-depth. 
. ."titerature searches are designed and executed by 
„..librarianS;to jeet..the,infofTOtibn;fleed5-of ^ — : 
individual adoimstrators/school board. personnel, 
teachers, researchers, ,parDnt5, cocinunity gfoups» 
andEothers Interasted in securing, the latest and 
, best inforaatlon that is available on a specific ' 
-education-related subject. . " 

, Wwt Isa RISHiterature search? ^ ^ 

LIteratiire Marches are based on the^lSE ■ 
Library's extensive collection of books, . 

a journals, researchjreports,' 'theses, 'and ERIC ' ' 
ydocuwnts.'' But^'RISE search, goes beyond the 
Library' to wploit'theinfomal/himan, 
educatlotal^nforrofion, network Jo ' 

V ' ill, »)■ 'effort. 'to retrieve, iflfoniation. on practices, 
theories; and research bearing ori( the, issue, or , 

• problem that a RISE cl ielit is .currently tackling. ' 
./■■This .service is es'peclally.'useful for locating- }■ 

• less easily accessible Canadiari and^local" i 
materials. The prodicf of >he'iearch,as VeH ks.' ', 
the search Itself is custow-tailored to each ^ , 
client's specifications, but. rise; typieal'ly::. ■ ■ : 

'..produces an , . . ■ ■ ■■ , , " ■ 

' ■ ' ^InfofTDation "Pacto(|e " • ; . ; . „ . . : ' ; ■; 

; '.' 'The,;5Kul.ts of .th'e."l-i.tePature search are^ • 
■V :«sua(ly .iofvarded^:^^ the ' 

■ of im "Jnfoniiation.package"*-a^^ '. 

• ^ ; ■ ■•8nd;photocopies,of''rele^^^^ ; ' 

;; /as; directions for procuriiig book?' and other ' 
/ V'^-iRaterj'sl s. not Suitable for photocopytng. 
• ,; . \Sgch a "pacl<age" may be-as cof rehensive 
>r as streamlined as' the paPtlculsr client * 
desires. Scnetlmes a few good: articles 
or a surary of the needed fac^s, without, 
abibliography,iril!'sufflc8. Clients In 
• Other situations, hoirever,.ray prefer'not ' . 
only a list of. references; but an.. . .. 



, # ■ ■■ , • 
•Annotated Bibliography 

■■ Annotations, 'or.abstracts/swrizing the , ' 
.centents.of every iten llstedin the biblle-;.. 
•graphy can be ■supplied on request'. Further- ' • 
i»re, to obtain sost efficiently an-accurate'' ; 
s^se of the trends In the literature on a' , 
particular topic, cl lents ray request (Kit : ' 
"-. only an annotated bibliography, but a . . ■. , 

■« Reviewof.the"LiteraturB •■ ■ 

■RISE Kill,' if 'requested, provide'a sumry 
description of the. literature as a whole-a ' 
"reviet of ine literaturft"-in addition to 
,or instead of ?n annotated bibliography. oc ": 
•■ *intornation,package." ■. .' .■.* 

Costs of -RISE ' ; ' 

■ ; The cost of a RISE I iterature' search depends on 'tJie ■ 
,■ tiTOTequired,,in each case. The r3t<f Is J12.00 per, 
. hour. 'The charge for photocopying. is 20f per page, ■■ 

»i1ti;a:$2.00 iiiimnium per order. , I: the time »hen- 
,;the search isqrranged, a clie)it|.ay, of .course,. 

■ speci fy -a iiaxiBtffl amount of time to.be ansumed - 
: ■ aAd'a iiBxiiiiuiD nutber of pages to be-phortocopled. 

At'the.sane tiiiie, the librarian may be able to 

•estimate' the,, nuniber of hours that wi ll be^.required 
•,. to provide^thel.infonnjfion needed'. ,'Dupiicates' of 
-.bibliographies onji-le will be supplied'.'at:^' ,' 

reduced rate.'. . - ■ . ' , / 

.,\. _Service by.AnnuaJ Contract ' ' " ,. 

: , Sct\ool;boards and .other organ izations^oay find" ' 

\ jit qjnvenient .toiral^e RIS^ 
.personnel, on 'demand over an extended period of 
time; . This service can be arranged contractually ' 

^ through RISE, . > . ; 



^ Toplcs^JorRISE Searches- • 



The' list of potential toplcs,for RISE literature- 
searches Is I Inited-'only by a liberal definition 
ot':the field, of "education.*' For exainple; ..' ,. 

♦TheRoleof the Teacher In School 
'. Decisi.on-ibki^g.. . ; 



I' . 



■•IhfOptiiw'Size of Secondary Schools '*' 
•CurrlculuDi Materials for, Values Eduiflon - 



.■.•.Evaluation;of!^awlty .in Unlverslt^^\^^' . 
,'and ,Coiiiwn|.ty Colleges . ' 



■ •.'Death and Children ' 

'■■' ^ ■ . : , 

'. • ^•Alternative Kindergarten Entry Patterns 

' >' < Method^ torTeachiit Adults ' 



Hoir to Arrange a RISE Literature Search 

A search ray be, arrangM. by completing the fom ■ 
on the reverse side of thl^ brochure, by 'writing 
a letter describing the subject 'in detail, or by 
telephoning RISE directly. "•; . ; / . 

For further I nfoniatlon,. or. 1o arrange'a search, '• 
please contact: ■ 

UndfCoraanV Librarian ' • 
^ . Research Infontatlon Service for Education 
:OISE library " ' ' 

.■ 252 Bloor Street liest •■ ' v, 
' Toronto, Ontario H5S TY6 , ' ,' 

/ ; (4l6r 923-6Ml, Ext. 202 ■ ■ ■ 




i 



